- 3054 Views
- 4 replies
- 2 kudos
Resolved! Unable to lunch cluster in Databricks as my azure subscription has been disabled
Azure subscription- disabledDatabricks subscription- free trial 13 day leftDatabricks host- AzureThe cluster is not getting created as my Azure subscription has been disabled after a month of free trial. However, Databricks subscription has still got...
- 3054 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Aanchal Soni​ We haven't heard from you since the last response from @Tyler Retzlaff​ ​, and I was checking back to see if her suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to o...
- 2 kudos
- 4109 Views
- 5 replies
- 2 kudos
Resolved! Is there a way to list the dlt maintenance jobs through the API?
After creating the delta pipeline, I would like to get details from the dlt maintenance job automatically created by Databricks, like the scheduled time when the dlt maintenance tasks will be executed. However, it seems the Job API 2.1 doesn't cover ...
- 4109 Views
- 5 replies
- 2 kudos
- 2 kudos
Hi @Debayan Mukherjee​ ,Actually the Databricks Jobs API documentation has not been fixed yet. The parameter `job_type` should be included in the list endpoint request documentation. Please do this in order to avoid unnecessary questions here in the ...
- 2 kudos
- 685 Views
- 0 replies
- 0 kudos
Hi, Cat! I’m applying for a position at Databricks and was hoping to get some current Brickster insights. I’ve been wanting to join the company for a ...
Hi, Cat! I’m applying for a position at Databricks and was hoping to get some current Brickster insights. I’ve been wanting to join the company for a while!! Thanks in advance
- 685 Views
- 0 replies
- 0 kudos
- 1150 Views
- 0 replies
- 0 kudos
 Dear Community-  Get ready to mark your calendars for the upcoming Databricks Community Social event! Happening on June 16th, 2023, this event promis...
Dear Community- Get ready to mark your calendars for the upcoming Databricks Community Social event! Happening on June 16th, 2023, this event promises to be the ultimate monthly gathering for everyone in the Databricks Community.Join us for an hour ...
- 1150 Views
- 0 replies
- 0 kudos
- 7077 Views
- 15 replies
- 4 kudos
Welcome 2023 Virtual hackathon participants, we're happy to have you! ✋  Please use this space to ask questions, we'll have some folks from Da...
Welcome 2023 Virtual hackathon participants, we're happy to have you! Please use this space to ask questions, we'll have some folks from Databricks and the community join to help out. We're really excited to see what you work on and if you have any ...
- 7077 Views
- 15 replies
- 4 kudos
- 4 kudos
Hi, I also have another question. Do we get any Databricks platform access for the period of hackathon? My company didn't use one and the trial is only 14 days. I'm pretty aware of the capability and since the hackathon are held by Databricks I think...
- 4 kudos
- 2389 Views
- 0 replies
- 0 kudos
java.lang.SecurityException: Could not verify permissions for DeleteFromTable ERROR IN EXTERNAL SYNAPSE TABLE
Hi guys, I am trying to delete an external table in Databricks that is connected to a Synapse table (via the com.databricks.spark.sqldw connector) but got the error shown below:Apart from that, when I try to execute an DELETE and INSERT actions (like...
- 2389 Views
- 0 replies
- 0 kudos
- 657 Views
- 0 replies
- 0 kudos
#[Data Bricks]​ @Kalpit Dhaked​Â
#[Data Bricks]​ @Kalpit Dhaked​
- 657 Views
- 0 replies
- 0 kudos
- 5467 Views
- 2 replies
- 4 kudos
Resolved! Workspace not getting created
Hey guys,I tried to create a workspace, I didn't encountered error like this. I provided everything correctly but don't know why I'm getting this. Tried doing it by using different Data bricks Id and AWS ID also access this on AWS Root account
- 5467 Views
- 2 replies
- 4 kudos
- 4 kudos
https://docs.gcp.databricks.com/administration-guide/workspace/create-workspace.html
- 4 kudos
- 1403 Views
- 1 replies
- 1 kudos
Connecting to Azure SQL database using R in Databricks and Azure Key Vaults
I'm trying to connect to an Azure SQL database using R in Databricks. I want to read the credentials stored in Azure secret key vaults rather than hard coding in R code. I've seen some examples of it being done in Scala, however i'm after a R solutio...
- 1403 Views
- 1 replies
- 1 kudos
- 1 kudos
Did you find a solution for this @Long Pham​ ?? I am having the same issue
- 1 kudos
- 2674 Views
- 1 replies
- 2 kudos
Resolved! What is the maximum number of mount points can be created from a databricks workspace to a ADLS storage account?
We had a usecase where mounts are created at a folder level. Now the number of folders created are increasing. Is there a limit on data bricks on number of mount point creation
- 2674 Views
- 1 replies
- 2 kudos
- 2 kudos
Azure Databricks mounts create a link between a workspace and cloud object storage, which enables you to interact with cloud object storage using familiar file paths relative to the Databricks file system. Mounts work by creating a local alias under ...
- 2 kudos
- 1493 Views
- 2 replies
- 6 kudos
Have you ever wondered how to automate your #databricks jobs and workflows without using the UI? If you want to manage your Databricks resources as co...
Have you ever wondered how to automate your #databricks jobs and workflows without using the UI? If you want to manage your Databricks resources as code, you should check out Terraform.Here is a simple example of creating a job that runs a notebook o...
- 1493 Views
- 2 replies
- 6 kudos
- 6 kudos
or use ADF Still waiting for actual added value on using Databricks Workflow over ADF.
- 6 kudos
- 2578 Views
- 1 replies
- 2 kudos
Checkpoint issue when loading data from confluent kafka
I have a streaming notebook which fetches messages from confluent Kafka topic and loads them into adls. It is a streaming notebook with the trigger as continuous processing. Before loading the message (which is in Avro format), I'm flattening out the...
- 2578 Views
- 1 replies
- 2 kudos
- 2 kudos
Best approach is to not to depend on Kafka’s commit mechanism! We can store processing result and message offset to external data store in the same database transaction. So, if the database transaction fails, both commit and processing will fail and ...
- 2 kudos
- 3318 Views
- 3 replies
- 0 kudos
Resolved! Not received my certificate after passing Databricks Certified Associate Developer for Apache Spark 3.0 - Python.
I've successfully passed Databricks Certified Associate Developer for Apache Spark 3.0 - Python but still have not received the certificate. E-mail : anwarpatel91@gmail.com
- 3318 Views
- 3 replies
- 0 kudos
- 0 kudos
@Nadia Elsayed​ could you please help me with this issue I need to send my certificate to my team.
- 0 kudos
- 5129 Views
- 2 replies
- 0 kudos
Display count of records in all tables in hive meta store based on one of the column value.
I have a DB name called Test in Hive meta store of data bricks. This DB contains around 100 tables. Each table has the column name called sourcesystem and many other columns. Now I need to display the count of records in each table group by source sy...
- 5129 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Krish K​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 0 kudos
- 1818 Views
- 1 replies
- 1 kudos
Resolved! Unique ID of table values is not unique anymore after merge every x-times
I have two tables with unique IDs:ID val ID val1 10 1 102 11 2 103 13 ...
- 1818 Views
- 1 replies
- 1 kudos
- 1 kudos
@Lukas Goldschmied​ :There are a few reasons why you might be experiencing this issue:Data Skew: Data skew is a common problem in distributed computing when one or more nodes in the cluster have more data to process than others. This can lead to long...
- 1 kudos