cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Braxx
by Contributor II
  • 2775 Views
  • 3 replies
  • 3 kudos

Resolved! cluster creation - access mode option

I am a bit lazy and trying to manually recreate a cluster I have in one workspace into another one. The cluster was created some time ago. Looking at the configuration, the access mode field is "custom": When trying to create a new cluster, I do not...

Captureaa Capturebb
  • 2775 Views
  • 3 replies
  • 3 kudos
Latest Reply
yatharth
New Contributor III
  • 3 kudos

I am facing the same type of issue and now changing back to old UI option is not available, cause of this issue i am not able to view cluster metrics

  • 3 kudos
2 More Replies
System1999
by New Contributor III
  • 2730 Views
  • 7 replies
  • 0 kudos

My 'Data' menu item shows 'No Options' for Databases. How can I fix?

Hi, I'm new to Databricks and I've signed up for the Community edition.First, I've noticed that I cannot return to a previously created cluster, as I get the message telling me that restarting a cluster is not available to me. Ok, inconvenient, but I...

error
  • 2730 Views
  • 7 replies
  • 0 kudos
Latest Reply
System1999
New Contributor III
  • 0 kudos

Hi @Suteja Kanuri​ ,I get the error message under Data before I've created a cluster. Then I still get it when I've created a cluster and a notebook (having attached the notebook to the cluster). Thanks.

  • 0 kudos
6 More Replies
Data_Analytics1
by Contributor III
  • 4316 Views
  • 5 replies
  • 0 kudos

"Waiting to run" status of the cell

Whenever I tried to execute the cell, it is not executing and it says waiting to run and gets stuck there. I tried this with different clusters but the problem still persist.What should be the standard process if I create a new cluster and wants to a...

  • 4316 Views
  • 5 replies
  • 0 kudos
Latest Reply
NandiniN
Valued Contributor III
  • 0 kudos

Hello @Mahesh Chahare​ , The "Waiting to run" message appears usually when the cluster start or library installation is in progress. If you are running the commands on an interactive notebook, and you have clicked on "Run All", the commands will get ...

  • 0 kudos
4 More Replies
lurban
by New Contributor
  • 1021 Views
  • 1 replies
  • 0 kudos

Delta Live Tables Development Mode Resets Cluster On Each Trigger

I believe this is a bug identified, but in the last few days, each time I trigger a test Delta Live Tables run in Development mode, the associated cluster will take 5-7 minutes to spin up each time. The cluster does stay on as anticipated in the comp...

  • 1021 Views
  • 1 replies
  • 0 kudos
Latest Reply
jose_gonzalez
Moderator
  • 0 kudos

Hi,Can you share your cluster JSON settings? it will help us to undertand the settings and VMs you are using.

  • 0 kudos
Kaniz
by Community Manager
  • 800 Views
  • 1 replies
  • 1 kudos
  • 800 Views
  • 1 replies
  • 1 kudos
Latest Reply
Priyanka_Biswas
Valued Contributor
  • 1 kudos

Here is the command to create cluster using databricks-clidatabricks clusters create --json-file create-cluster.jsoncreate-cluster.json{ "cluster_name": "my-cluster", "spark_version": "7.3.x-scala2.12", "node_type_id": "i3.xlarge", "spark_conf": ...

  • 1 kudos
supremefist
by New Contributor III
  • 3375 Views
  • 5 replies
  • 2 kudos

Resolved! New spark cluster being configured in local mode

Hi,We have two workspaces on Databricks, prod and dev. On prod, if we create a new all-purpose cluster through the web interface and go to Environment in the the spark UI, the spark.master setting is correctly set to be the host IP. This results in a...

  • 3375 Views
  • 5 replies
  • 2 kudos
Latest Reply
scottb
New Contributor II
  • 2 kudos

I found the same issue when choosing the default cluster setup on first setup that when I went to edit the cluster to add an instance profile, I was not able to save without fixing this. Thanks for the tip

  • 2 kudos
4 More Replies
Venkat1
by New Contributor II
  • 2435 Views
  • 3 replies
  • 1 kudos

Resolved! Error: "Backend service unavailable" when trying to start a cluster in community edition.

I am using community edition of databricks for learning and hands-on projects. However, when I try to create a cluster today, I am getting an error popup- "Backend service unavailable". I would like to know if it is a problem with my account or a bac...

  • 2435 Views
  • 3 replies
  • 1 kudos
Latest Reply
Vidula
Honored Contributor
  • 1 kudos

Hey there @Venkat K​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Th...

  • 1 kudos
2 More Replies
MMMM
by New Contributor III
  • 6627 Views
  • 15 replies
  • 2 kudos

cluster issue

I signed up with databricks free trial but I am not be able to create new cluster , could you help me in this regard ?When i create cluster nothing happens and it terminates automatically , I'm on aws

  • 6627 Views
  • 15 replies
  • 2 kudos
Latest Reply
MMMM
New Contributor III
  • 2 kudos

Could you help in answer all my questions 1 by one again

  • 2 kudos
14 More Replies
User16765131552
by Contributor III
  • 1472 Views
  • 1 replies
  • 1 kudos

Resolved! Create a new cluster in Databricks using databricks-cli

I'm trying to create a new cluster in Databricks on Azure using databricks-cli.I'm using the following command:databricks clusters create --json '{ "cluster_name": "template2", "spark_version": "4.1.x-scala2.11" }'And getting back this error: Error: ...

  • 1472 Views
  • 1 replies
  • 1 kudos
Latest Reply
User16765131552
Contributor III
  • 1 kudos

I found the right answer here.The correct format to run this command on azure is:databricks clusters create --json '{ "cluster_name": "my-cluster", "spark_version": "4.1.x-scala2.11", "node_type_id": "Standard_DS3_v2", "autoscale" : { "min_workers": ...

  • 1 kudos
User15813097110
by New Contributor III
  • 1191 Views
  • 1 replies
  • 0 kudos
  • 1191 Views
  • 1 replies
  • 0 kudos
Latest Reply
User15813097110
New Contributor III
  • 0 kudos

Since the SparkContext is already up and running, it requires a restart. Technically, it might be possible to kill the JVM process and restart it but we do not recommend that approach. In this case, we recommend restarting the cluster so that the Sp...

  • 0 kudos
Labels