Databricks Community

jwilliam · 09-30-2022

I didn't found any documentation on Databricks Cluster Manager. Could anyone give me some resources on this topic?

jwilliam · 09-30-2022

Currently, when I install libraries on my clusters. This errors happens:WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol...

jwilliam · 08-30-2022

What is the maximum of concurrent streaming jobs for a cluster? How can I have the right amount of concurrent streaming jobs for different cluster configuration?Should I use multiple cluster for different jobs or combine it into a big cluster to hand...

jwilliam · 08-30-2022

I'm using Python Wheel Task in Databricks job with WHEEL dependencies. However, the cluster installed the dependencies as JAR instead of WHEEL. Is this an expected behavior or a bug?

jwilliam · 07-27-2022

We are using Databricks with Premium Tier in Azure Gov Cloud. We check the Data section but don't see any options to Create Metastore.

jwilliam · 10-05-2022

Hi @Akash Bhat , thank you for your reply. I really surprise that Databricks clusters use Spark's Standalone cluster manager because if I read correctly here, Databricks uses Kubernnetes as cluster manager https://www.databricks.com/blog/2021/08/06/...

jwilliam · 09-04-2022

I worried about the cost of this approach, spin up new cluster for every streaming job running non stop required a lot of resources.

jwilliam · 07-26-2022

Thanks @Ravirahul Padmanabhan , does Databricks support these features in the future or it is not possible by design?

jwilliam · 05-29-2022

Hi @Joseph Kambourakis , does Databricks have any plans to support this in the future?

jwilliam · 05-06-2022

Thank you. Will traditional cluster support serverless execution in the future or only SQL endpoints support that?And are there any optimization tweaks in Databricks SQL that makes it perhaps faster than traditional Databricks cluster running only SQ...

Databricks Community

User Stats

User Activity

Differences between Spark Cluster Manager and Databricks Cluster Manager?

Does libraries installation happen on Data Plane or Control Plane?

What is the maximum of concurrent streaming jobs for a cluster?

[BUG] Databricks install WHL as JAR in Python Wheel Task?

Has Unity Catalog been available in Azure Gov Cloud?

Re: Differences between Spark Cluster Manager and Databricks Cluster Manager?

Re: What is the maximum of concurrent streaming jobs for a cluster?

Re: Cannot use Web Terminal when creating cluster with Custom container.

Re: How to view the SQL Query History of traditional Databricks cluster (not Databricks SQL)?

Re: What is the difference between Databricks SQL vs Databricks cluster with Photon runtime?