- 4397 Views
- 5 replies
- 1 kudos
Resolved! My jobs and cluster were deleted in a suspicious way
I want to know what happen with my cluster and if I can recover it.I entered to my Databricks account and I didn't found my jobs and my cluster. I couldn't find any log of the deleted cluster because the log is into the cluster interface. I entered t...
- 4397 Views
- 5 replies
- 1 kudos
- 1 kudos
Dear folks,When the tables has been deleted, then why I am unable to create the table with same name.It continiously giving me error"DeltaAnalysisException: Cannot create table ('`spark_catalog`.`default`.`Customer_Data`'). The associated location ('...
- 1 kudos
- 6003 Views
- 8 replies
- 6 kudos
Resolved! Cannot spin up a cluster
HiWhen I try to spin up a cluster, it gives me a bootstrap timeout error{ "reason": { "code": "BOOTSTRAP_TIMEOUT", "parameters": { "databricks_error_message": "[id: InstanceId(i-00b2b7acdd82e5fde), status: INSTANCE_INITIALIZING, workerEnv...
- 6003 Views
- 8 replies
- 6 kudos
- 6 kudos
Thanks guys. It's indeed a network issue on the AWS side. It's resolved now
- 6 kudos
- 2486 Views
- 4 replies
- 0 kudos
Create cluster error: Backend service unavailable
hello,i'm new to Databricks (community edition account) and encountered a problem just now.When creating a new cluster (default 10.4 LTS) it fails with the following error: Backend service unavailable.I've tried a different runtime > same issue.I've ...
- 2486 Views
- 4 replies
- 0 kudos
- 0 kudos
Hey mbvb_py,I'm sorry to hear you're facing this "Backend service unavailable" issue with Databricks. I've encountered similar problems in the past, and it can be frustrating. Don't worry; you're not alone in this!From my experience, this error can o...
- 0 kudos
- 1532 Views
- 3 replies
- 2 kudos
How to install cmdstanpy in dbx cluster
I have built an HMC model using cmdstand. In my local machine, I have install cmdstan for the following approach. import cmdstanpy cmdstanpy.install_cmdstan()But in Databricks I need to reinstall it every time when I train a new model, from the noteb...
- 1532 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @Rajamannar Aanjaram Krishnamoorthy Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 2 kudos
- 1535 Views
- 3 replies
- 1 kudos
Could not launch jobs due to node_type_id (instance) unavailability
I am running hourly job on a cluster using p3.2xlarge GPU instance, but sometimes cluster couldn't start due to instance unavailability. I wander is there is any fallback mechanism to, for example, try a different instance type if one is not availabl...
- 1535 Views
- 3 replies
- 1 kudos
- 1 kudos
(AWS only) For anyone experiencing capacity related cluster launch failures on non-GPU instance types, AWS Fleet instance types are now GA and available for clusters and instance pools. They help improve chance of successful cluster launch by allowi...
- 1 kudos
- 707 Views
- 0 replies
- 1 kudos
Connect to warehouse vs connect to compute/cluster
When I create a warehouse, there are connection details which I was able to successfully use, but there are also connection details when I navigate in the console to Compute->configuration->Advanced options-> JDBC/ODBC What is the difference between ...
- 707 Views
- 0 replies
- 1 kudos
- 7703 Views
- 1 replies
- 2 kudos
Getting HTTP 502 bad gateway error!
Hello all,I am suddenly getting an HTTP 502 and DRIVER_LIBRARY_INSTALLATION_FAILURE error during the Python library installation when the cluster gets initialized. I have around 10 Python packages out of which 2-3, packages always failed to install a...
- 7703 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Bhargav Shir Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 2 kudos
- 2133 Views
- 4 replies
- 2 kudos
Resolved! Unable to lunch cluster in Databricks as my azure subscription has been disabled
Azure subscription- disabledDatabricks subscription- free trial 13 day leftDatabricks host- AzureThe cluster is not getting created as my Azure subscription has been disabled after a month of free trial. However, Databricks subscription has still got...
- 2133 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Aanchal Soni We haven't heard from you since the last response from @Tyler Retzlaff , and I was checking back to see if her suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to o...
- 2 kudos
- 1450 Views
- 1 replies
- 0 kudos
Creating cluster from ADF linked service with Workspace init script
Similar issue: https://stackoverflow.com/questions/76220211/create-new-databricks-cluster-from-adf-linked-service-with-initscripts-from-abfsI am trying to create clusters using ADF linked service where the cluster is configured with a init script. As...
- 1450 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Oscar Dyremyhr Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 0 kudos
- 16848 Views
- 9 replies
- 9 kudos
Cluster occasionally fails to launch
I have a daily running notebook that occasionally fails with the error:"Run result unavailable: job failed with error message Unexpected failure while waiting for the cluster Some((xxxxxxxxxxxxxxx) )to be readySome(: Cluster xxxxxxxxxxxxxxxx is in un...
- 16848 Views
- 9 replies
- 9 kudos
- 9 kudos
hello any update on this issue ?We have the same problem and no logs to investigate (even in dbfs when we activate the logging)Unexpected failure while waiting for the cluster (<id of our cluster>) to be ready: Cluster <id of our cluster> is in unexp...
- 9 kudos
- 2064 Views
- 2 replies
- 1 kudos
Integration Dolly with Databricks
Hi Databricks Team,Could you please share any links /docs/Sample notebooks to integrate Dolly with Databricks, our aim is to generate SQL queries based on the free text and execute it via databricks cluster/SQL warehouse.
- 2064 Views
- 2 replies
- 1 kudos
- 1 kudos
https://www.dbdemos.ai/demo.html?demoName=llm-dolly-chatbot is a good demonstration of Dolly (or really any LLM) for question answering. LLMs like this are not for SQL generation, but other LLMs are, like starcoderbase
- 1 kudos
- 3664 Views
- 8 replies
- 0 kudos
R packages not getting installed on cluster when creating cluster from dockerfile
I'm trying to use dockerfile to create a cluster which has Robyn (https://facebookexperimental.github.io/Robyn/) and other R libraries installed. But it is failing to install the R libraries to the cluster. When I run the container in interactive mod...
- 3664 Views
- 8 replies
- 0 kudos
- 0 kudos
What there has been no answer here! @Debayan Mukherjee @Vartika Nain So I am running into this same problem as the idea of having to wait 45 minutes for libraries to install is absolutely wild as well as I have done everything outside of working w...
- 0 kudos
- 7253 Views
- 3 replies
- 3 kudos
Resolved! Data Tab is not showing any databases and tables even though cluster is running (Community edition)
Hi, I have a cluster running: But I dont see anything in Data Tab: As you can see it tells about some error, but error appeared after I deleted clusters which were terminated. Before it said something that cluster is not running, dont remember exactl...
- 7253 Views
- 3 replies
- 3 kudos
- 3 kudos
@Retko Okter You need to enable DBFS File Browser from the Admin Settings hope this helps.
- 3 kudos
- 24482 Views
- 4 replies
- 1 kudos
Resolved! How to add pre-commit hook to the Git Client on Databricks Cluster?
I'd like to add a Git pre-commit hook to the Databricks Cluster.This pre-commit hook should be executed when pushing to GitHub.Why would I need a pre-commit hook on a Databricks Cluster?My goal is to run blackbricks and format all notebooks automatic...
- 24482 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @Dejan Hrubenja Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 1 kudos
- 3981 Views
- 5 replies
- 4 kudos
Is there a way to clone job cluster or edit cluster using JSON?
I've created workflow job (let say job A) and set up job cluster configuration for it.Now I want to create another workflow job (job B) but use almost the same settings for job cluster.I can see cluster settings in JSON (for both jobs) but I can't ed...
- 3981 Views
- 5 replies
- 4 kudos
- 4 kudos
Also you can use terraform exporter with -match flag to get a .tf definition for a job A. Once initialized, you can define job B.Another option is to use dbx
- 4 kudos