Cannot create Databricks spark compute in new latest community edition ??

[udrao56al]

I am only seeing serverless ,how to create a compute with spark configs in latest community edition ??? Please suggest or guide ?

[Khaja_Zaffer]

Hello @udrao56al 

Good day!! Happy halloween mate!

In the latest Databricks Free Edition (which replaced the legacy Community Edition), you cannot create traditional Spark clusters with a manual UI for custom Spark configurations like you could before.

More details : https://docs.databricks.com/aws/en/getting-started/free-edition-limitations

• Your screenshot shows the SQL Warehouses tab under Compute—that's only for SQL queries (optimized for BI tools like Power BI).
• Spark compute (for notebooks) is fully serverless and on-demand in Free Edition. No manual cluster creation needed!

[udrao56al]

i am seeing this, am i using wrong community edition pls suggest

[udrao56al]

can see i can work on dataframes only

[Khaja_Zaffer]

Hello @udrao56al 

I can help you on this. But dont forget to give my solution as right answer. 

So it says you need to use a workspace with single user cluster, unfortunately databricks isnt providing us to create any clusters in free edition but you can use legacy edition. : https://community.cloud.databricks.com/ select legacy edition and login, remember commute can be- ONLY 15.4 or below DBR. Above 15.4 DBR, legacy commutes are not working or supported. the cluster tries to start in 15.4 + DBR but it will not work. So only use 15.4 below DBR, you can use general or ML based commute it works only below 15.4 DBR.

I checked on legacy eidition and your code works. 

so databricks might end use of legacy workspaces very soon there is no ETA. thats sad but its fact now. 

Thank you. I hope this helps.