cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

16.2 (includes Apache Spark 3.5.2, Scala 2.12) cluster in community edition taking long time

Maser_AZ
New Contributor II

16.2 (includes Apache Spark 3.5.2, Scala 2.12) cluster in community edition taking long time to start.

I m trying to launch 16.2 DBR but it seems the cluster which is one node is taking long time . Is this a bug in the community edition ?

Here is the url for the same- https://community.cloud.databricks.com/compute/clusters/0303-155441-2azsb6la?o=5323728790122796

 

 

 

1 REPLY 1

mark_ott
Databricks Employee
Databricks Employee

The long startup time for a Databricks Runtime 16.2 (Apache Spark 3.5.2, Scala 2.12) single-node cluster in Databricks Community Edition is a known issue and not unique to your setup. Many users have reported this situation, with some clusters taking significantly longer than the usual 5โ€“10 minutes to start, and in some cases failing to launch or staying "pending" indefinitely. It does not appear to be a direct bug in the 16.2 DBR itself, but rather an intermittent reliability and capacity limitation of the free Community Edition platform.โ€‹

Common Findings

  • Startup delays of over 10 minutes are widely reported by other users, especially with the newest DBR versions.โ€‹

  • Cluster launch reliability tends to degrade during peak usage times due to limited resources available for Community Edition clusters.โ€‹

  • Creating a new cluster (rather than restarting a terminated one) offers a partial workaround, but does not fully resolve the delays.โ€‹

  • No official fix or update has been issued for these delays specifically in Community Edition as of November 2025, and the issue is not tied to a specific DBR version.โ€‹

Practical Workarounds

  • Try creating a new cluster instead of restarting an old one if yours gets stuck.

  • Patience is unfortunately required, as sometimes clusters will start after a long waiting period.

  • If possible, try launching clusters at off-peak times or try changing the DBR version or region if those options are available in your console.โ€‹

Conclusion

The delays you are experiencing are a limitation of the Databricks Community Edition and there is no clear fix at this time. It is recommended to use paid or enterprise versions for mission-critical or time-sensitive workloads, as these offer significantly faster and more reliable provisioning. For learning and experimentation, delays are common and expected, especially with single node clusters during busy periodsods.โ€‹

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now