Cannot create Databricks spark compute in new latest community edition ??

udrao56al
New Contributor II

‎10-31-2025 08:55 AM

I am only seeing serverless ,how to create a compute with spark configs in latest community edition ??? Please suggest or guide ?

udrao56al_0-1761926018766.png

 

Labels:
0 Kudos

Khaja_Zaffer
Esteemed Contributor

‎10-31-2025 09:14 AM

Hello @udrao56al 

Good day!! Happy halloween mate!

 

In the latest Databricks Free Edition (which replaced the legacy Community Edition), you cannot create traditional Spark clusters with a manual UI for custom Spark configurations like you could before.
  • Your screenshot shows the SQL Warehouses tab under Compute—that's only for SQL queries (optimized for BI tools like Power BI).
  • Spark compute (for notebooks) is fully serverless and on-demand in Free Edition. No manual cluster creation needed!
0 Kudos

udrao56al
New Contributor II
In response to Khaja_Zaffer

‎10-31-2025 10:04 AM

i am seeing this, am i using wrong community edition pls suggest

udrao56al_0-1761930239036.png

 

0 Kudos

udrao56al
New Contributor II
In response to udrao56al

‎10-31-2025 10:17 AM

can see i can work on dataframes only

0 Kudos

Khaja_Zaffer
Esteemed Contributor
In response to udrao56al

‎11-01-2025 03:18 AM

Hello @udrao56al 

I can help you on this. But dont forget to give my solution as right answer. 

So it says you need to use a workspace with single user cluster, unfortunately databricks isnt providing us to create any clusters in free edition but you can use legacy edition. : https://community.cloud.databricks.com/ select legacy edition and login, remember commute can be- ONLY 15.4 or below DBR. Above 15.4 DBR, legacy commutes are not working or supported. the cluster tries to start in 15.4 + DBR but it will not work. So only use 15.4 below DBR, you can use general or ML based commute it works only below 15.4 DBR.

I checked on legacy eidition and your code works. 

Khaja_Zaffer_0-1761991869964.png

 

so databricks might end use of legacy workspaces very soon there is no ETA. thats sad but its fact now. 

 

Thank you. I hope this helps.

0 Kudos