- 1143 Views
- 1 replies
- 0 kudos
Databricks Workspace deleted - Need to recover
Hi ,Have created Databricks workspace on GCP. It was somehow deleted which Iam not sure . Is there anyway to recover database.It was deleted on 30-Jun-2025. Is there any retention period to recover.Thanks,Balbeer
- 1143 Views
- 1 replies
- 0 kudos
- 0 kudos
sorry typo 30-jun-2024
- 0 kudos
- 8089 Views
- 3 replies
- 0 kudos
Resolved! Notebook cells stuck on "waiting to run" when using Cluster Libraries
Hey,we're observing the following problem when trying to run a notebook on a cluster with libraries installed:All notebook cells are stuck in "Waiting to run" (also ones containing only a '1+1' statement).When running the cluster without installing t...
- 8089 Views
- 3 replies
- 0 kudos
- 0 kudos
Did you manage to fix this issue? I am facing a similar situation while running a notebook to read the XML files from the storage account.
- 0 kudos
- 2358 Views
- 3 replies
- 2 kudos
Notebook is stuck and cluster goes into waiting state while using spark libraries
Hey,We have installed the com.databricks:spark-xml_2.12:0.18.0 library in our VNET-injected Databricks workspace to read XML files from a storage account. The notebook runs successfully for text files when the cluster is started without the library i...
- 2358 Views
- 3 replies
- 2 kudos
- 2 kudos
Since it's a maven dependency it should be simply HTTP and port 80/443.Besides, are you aware that native XML support is included since runtime 14.3? This replaces the library spark-xml.
- 2 kudos
- 1807 Views
- 1 replies
- 1 kudos
Resolved! Do Databricks Update the Default Python Libraries in Cluster Runtimes?
Hi all,I’ve been trying to find information about whether Databricks regularly updates the default Python libraries in their cluster runtimes. I checked two different sources but didn’t find clear details.Default python libraries in runtime 11.3 LTS ...
- 1807 Views
- 1 replies
- 1 kudos
- 1 kudos
Yes, Databricks does that when releasing new versions of the runtime. Just compare the libraries of the other runtimes.
- 1 kudos
- 983 Views
- 0 replies
- 0 kudos
jar cluster install invalid authority
Hi allFirst time user - hope this is the right spot.My goal is to import and export to an onPrem Oracle database. To this end, I am attempting to upload the ojdbc8.jar to the cluster. This does not, however, go well. The error is:The error text: "Lib...
- 983 Views
- 0 replies
- 0 kudos
- 8781 Views
- 4 replies
- 1 kudos
Resolved! NAT Gateway with Azure Databricks
Hi all, what are the steps to enable external communication through a NAT Gateway? Our Databricks instance was created through VNET injection and did not have a NAT gateway created by default. We now want to pass external traffic through NAT gateway ...
- 8781 Views
- 4 replies
- 1 kudos
- 1 kudos
I made the changes and it works! I was able to communicate to the NAT Gateway IP in our external on-prem application.I noticed though that Databricks instance is not showing the NAT Gateway within Parameters. Is this an issue?
- 1 kudos
- 2059 Views
- 3 replies
- 1 kudos
Question regarding permission of azure databricks account console
We are facing an issue while onboarding pipelines to Azure Databricks.Our Databricks environment is deployed on an Azure subscription where all of us have owner permissions. However, we're encountering problems when trying to access the Azure Databri...
- 2059 Views
- 3 replies
- 1 kudos
- 1 kudos
Hello, Databricks admin account console is not linked to your Azure subscriptions.If you are owner of your sub, you will be admin of the workspaces instanciated in the sub. That's all.You need to find the identified Databricks admin for your company ...
- 1 kudos
- 1419 Views
- 1 replies
- 1 kudos
Spark event log frequently missing rollover logs
Hi,We are currently using the event log to gain some visibility to what spark is doing under the hood but we frequently find that rollover logs are missing and we are left with a partial set. Is there a reason for this or a bug being tracked? Is ther...
- 1419 Views
- 1 replies
- 1 kudos
- 1 kudos
I'm also having this issue , it seems to occur much more frequently on azure than aws, but even on aws jobs sometimes some of the logs will be missing
- 1 kudos
- 1295 Views
- 1 replies
- 0 kudos
Features tab under Machine learning shows error
Cannot resolve metastore id, go back. FeatureStoreError- Workspace Feature Store has been deprecated in the current workspace. Databricks recommends using Feature Engineering in Unity Catalog. Please reach out to system admin if you have any more que...
- 1295 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @rdvc,Could it be that this one workspace that has this problem is not configured to use Unity Catalog?
- 0 kudos
- 1328 Views
- 1 replies
- 0 kudos
How to access smtplib with ACL enables cluster
I am having a tough time to connect to smtp server from databricks with ACL enabled cluster , I am able to access with out ACL enabled cluster what can be done to access it via ACL enabled cluster import smtplibfrom email.mime.multipart import MIMEMu...
- 1328 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @unalluri9999 ,What error do you get? By ACL you mean IP access lists or something different? Your workspace is vnet injected?
- 0 kudos
- 4470 Views
- 0 replies
- 3 kudos
Databricks "Page Not Responding" Error Affecting All Users
For the past two days, our entire project team has been experiencing a recurring "Page Not Responding" error in Databricks. This issue occurs roughly every five minutes, making it impossible to run any code effectively.What's notable is that this pr...
- 4470 Views
- 0 replies
- 3 kudos
- 3688 Views
- 0 replies
- 0 kudos
Survey about cluster configuration and optimization
Hi everyone, I hope you are very well.In the research for my university we are conducting a survey to Databricks users, aimed to gather information about how cluster configuration and optimization is faced in the industry.If you like you can answer i...
- 3688 Views
- 0 replies
- 0 kudos
- 4564 Views
- 1 replies
- 1 kudos
Error running 80 task at same time in Job, how limit this?
Hi! I have a Job running to process multiple streaming tables. In the beginning, it was working fine, but now I have 80 tables running in this job, the problem is that all the runs are trying to run at the same time throwing an error. Is there a way ...
- 4564 Views
- 1 replies
- 1 kudos
- 1886 Views
- 1 replies
- 0 kudos
DABs vs API
DABs seem like a great way to build a project based workflow. However, I have a need to take a user's SQL and create a TABLE/VIEW based on it. We plan to use the API to submit the request but is this the best way going forward? Should we consider ...
- 1886 Views
- 1 replies
- 0 kudos
- 0 kudos
DABs use Terraform which in turn calls the API anyway. So, I guess it comes down to personal preference of deployment consistency, code maintenance etc. However, from your description of "taking a user's SQL" I'm assuming some sort of real-time appli...
- 0 kudos
- 1619 Views
- 1 replies
- 0 kudos
Assistance Required for Enabling Unity Catalog in Databricks Workspace
Hi,I hope this message finds you well.I am reaching out regarding a concern with Databricks Administrator privileges. I have an Azure subscription and I use Azure Databricks for my tutorials, but I currently do not have Global Administrator access, w...
- 1619 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello, each account should have at least one account administrator that is the one that has the permissions on the managed account and that can give you this access if applicable or assist you with the set up of the UC, you might need to ask internal...
- 0 kudos
