Databricks Community

Leodatabricks · 02-07-2023

When there are slow nodes, sometimes a job needs to resize its number of clusters to reach the required number of nodes. Is there any way to make sure no code is running before all nodes are secured? Thank you!

Leodatabricks · 11-17-2022

I have been getting this error sporadically. I'm loading a dataset and training a model using the dataset in notebook. Sometimes it works and sometimes it doesn't. I have seen similar posts and tried all solutions mentioned, log output size limit, sp...

Leodatabricks · 02-10-2023

Thank you again for your reply. Could you please let me know how can I open a support ticket? Also for the solution you mentioned, I'm using job submit instead of the interactive notebook, so I'm not sure when exactly all executors will be available ...

Leodatabricks · 02-09-2023

already disabled autoscaling. When you set larger number of worker nodes, you might not get all at once. Resize might be needed.

Leodatabricks · 02-08-2023

Is there an option to turn that optimization feature off then? When some workers are added later, I've experienced some weird connection lost issues when reading/writing data while running the code. Everything works well when all nodes are ready befo...

Leodatabricks · 02-08-2023

@Bilal Aslam might have a better phrasing of the question. What I mean is "how do I make sure my job does not start until all worker nodes in a Spark cluster are ready"

Leodatabricks · 02-08-2023

Thank you for the clarification. That's exactly what I mean. I'm not using autoscaling since I've been submitting a job to run with a required number of worker nodes. From my observation, even when some workers are not ready, the cluster will begin o...

Databricks Community

User Stats

User Activity

How to secure all clusters and then start running the code

Reason: Remote RPC client disassociated. Likely due to containers exceeding thresholds, or network issues. Check driver logs for WARN messages.

Re: How to secure all clusters and then start running the code

Re: How to secure all clusters and then start running the code

Re: How to secure all clusters and then start running the code

Re: How to secure all clusters and then start running the code

Re: How to secure all clusters and then start running the code