- 3320 Views
- 1 replies
- 0 kudos
Databricks Azure Cross-Tenant connection to storage account
I'm currently facing a challenge with establishing a cross-tenant connection between Azure Databricks in Tenant A and a Storage Account in Tenant B. Below is the detailed setup of both tenants:| Tenant A | Tenant B || -------- | -------- || Azure Dat...
- 3320 Views
- 1 replies
- 0 kudos
- 0 kudos
Have you tried connecting to the storage account from the compute plane itself?I've used this in a notebook to confirm that i can access a storage account over the private endpoint, even when i can't add it as an external data source in the UI.from a...
- 0 kudos
- 1449 Views
- 1 replies
- 1 kudos
Resolved! Can't Link Git and Databricks Community Edition
I am trying to link Git and Databricks but keep running into the error: "Error fetching credentials." I am on the Settings > Linked Accounts tab, and I cannot select anything except the "Retry" button at the bottom of the page, which does not resolve...
- 1449 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @DenJackson ,Community edition it pretty limite and it seems that the option to integrate repository is disabled. If you need more capabalities you can sign up for 14-day free trial.
- 1 kudos
- 1170 Views
- 1 replies
- 0 kudos
Alert ACL's not available
The list of available ACL's for alerts suggests there's a way to set "can run" and "can manage" permissions but neither the REST API nor the Databricks CLI show options for setting permissions. Is there a way to set acl's on alerts? If so, how?Alert ...
- 1170 Views
- 1 replies
- 0 kudos
- 0 kudos
The API call needed to set the ACLs for an alert and other object types as (alerts | dashboards | data_sources | queries) is:https://docs.databricks.com/api/workspace/dbsqlpermissions/set
- 0 kudos
- 1614 Views
- 2 replies
- 4 kudos
Changes in Databricks rest api
Hi all, Just wanted to ask if there is an announcement regarding changes on Databricks REST API? Because I had weird experiences in using the REST API. Specifically for Query History API Last Aug 29, 2024. I created a script to pull get request in t...
- 1614 Views
- 2 replies
- 4 kudos
- 4 kudos
Yeah, totally agree with you. It should be documented/mentioned somewhere. Or maybe the API should be versioned, so if they introduce a new version, it won't break existing workflows.Anyway, thanks for sharing!
- 4 kudos
- 1475 Views
- 2 replies
- 0 kudos
Removing Admin Users
Hello, I am trying to deal with something I thought would be straightforward, but am hitting some walls. Basically the original user associated with my Databricks account has left my organisation and, when trying to remove / disable this user, I am m...
- 1475 Views
- 2 replies
- 0 kudos
- 0 kudos
Just to follow-up; I can administer & disable OTHER account admins and do the needful in every other case, but this one user account is particularly privileged.
- 0 kudos
- 1223 Views
- 2 replies
- 0 kudos
CLI jobs create issue
I am trying to create a job using the CLI and getting the below error attachedThe command itself was grabbed from the UI so I know it is ok
- 1223 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @ragonzalez ,You can try to escape quotation marks and see if that helps. Something similar to below:{ \"custom_tags.test_tag\": { \"type\": \"fixed\", \"value\": \"test_value\" } }\n"And you don't have to provide whole request body to command lin...
- 0 kudos
- 1216 Views
- 2 replies
- 1 kudos
No possibility to schedule DLT once per minute
HelloI wanted to setup DLT to run every minute, previously it was possible with setting up in JSON "schedule": "1 * * * *" - but now I see that is not accepted - is there any other workaround to make it working ?
- 1216 Views
- 2 replies
- 1 kudos
- 1 kudos
in that case we can attach dlt to job ... but in json for dlt - I was not able to do that still
- 1 kudos
- 878 Views
- 1 replies
- 0 kudos
Databricks Workspace deleted - Need to recover
Hi ,Have created Databricks workspace on GCP. It was somehow deleted which Iam not sure . Is there anyway to recover database.It was deleted on 30-Jun-2025. Is there any retention period to recover.Thanks,Balbeer
- 878 Views
- 1 replies
- 0 kudos
- 0 kudos
sorry typo 30-jun-2024
- 0 kudos
- 6448 Views
- 3 replies
- 0 kudos
Resolved! Notebook cells stuck on "waiting to run" when using Cluster Libraries
Hey,we're observing the following problem when trying to run a notebook on a cluster with libraries installed:All notebook cells are stuck in "Waiting to run" (also ones containing only a '1+1' statement).When running the cluster without installing t...
- 6448 Views
- 3 replies
- 0 kudos
- 0 kudos
Did you manage to fix this issue? I am facing a similar situation while running a notebook to read the XML files from the storage account.
- 0 kudos
- 1777 Views
- 3 replies
- 2 kudos
Notebook is stuck and cluster goes into waiting state while using spark libraries
Hey,We have installed the com.databricks:spark-xml_2.12:0.18.0 library in our VNET-injected Databricks workspace to read XML files from a storage account. The notebook runs successfully for text files when the cluster is started without the library i...
- 1777 Views
- 3 replies
- 2 kudos
- 2 kudos
Since it's a maven dependency it should be simply HTTP and port 80/443.Besides, are you aware that native XML support is included since runtime 14.3? This replaces the library spark-xml.
- 2 kudos
- 1355 Views
- 1 replies
- 1 kudos
Resolved! Do Databricks Update the Default Python Libraries in Cluster Runtimes?
Hi all,I’ve been trying to find information about whether Databricks regularly updates the default Python libraries in their cluster runtimes. I checked two different sources but didn’t find clear details.Default python libraries in runtime 11.3 LTS ...
- 1355 Views
- 1 replies
- 1 kudos
- 1 kudos
Yes, Databricks does that when releasing new versions of the runtime. Just compare the libraries of the other runtimes.
- 1 kudos
- 770 Views
- 0 replies
- 0 kudos
jar cluster install invalid authority
Hi allFirst time user - hope this is the right spot.My goal is to import and export to an onPrem Oracle database. To this end, I am attempting to upload the ojdbc8.jar to the cluster. This does not, however, go well. The error is:The error text: "Lib...
- 770 Views
- 0 replies
- 0 kudos
- 6256 Views
- 4 replies
- 0 kudos
Resolved! NAT Gateway with Azure Databricks
Hi all, what are the steps to enable external communication through a NAT Gateway? Our Databricks instance was created through VNET injection and did not have a NAT gateway created by default. We now want to pass external traffic through NAT gateway ...
- 6256 Views
- 4 replies
- 0 kudos
- 0 kudos
I made the changes and it works! I was able to communicate to the NAT Gateway IP in our external on-prem application.I noticed though that Databricks instance is not showing the NAT Gateway within Parameters. Is this an issue?
- 0 kudos
- 1493 Views
- 3 replies
- 1 kudos
Question regarding permission of azure databricks account console
We are facing an issue while onboarding pipelines to Azure Databricks.Our Databricks environment is deployed on an Azure subscription where all of us have owner permissions. However, we're encountering problems when trying to access the Azure Databri...
- 1493 Views
- 3 replies
- 1 kudos
- 1 kudos
Hello, Databricks admin account console is not linked to your Azure subscriptions.If you are owner of your sub, you will be admin of the workspaces instanciated in the sub. That's all.You need to find the identified Databricks admin for your company ...
- 1 kudos
- 1050 Views
- 1 replies
- 1 kudos
Spark event log frequently missing rollover logs
Hi,We are currently using the event log to gain some visibility to what spark is doing under the hood but we frequently find that rollover logs are missing and we are left with a partial set. Is there a reason for this or a bug being tracked? Is ther...
- 1050 Views
- 1 replies
- 1 kudos
- 1 kudos
I'm also having this issue , it seems to occur much more frequently on azure than aws, but even on aws jobs sometimes some of the logs will be missing
- 1 kudos
