topic Re: Serverless All-purpose cluster in Free Edition in Databricks Free Edition Help

Serverless All-purpose cluster in Free Edition

Kai- — Thu, 26 Jun 2025 08:09:58 GMT

Hi Databricks community,

Good day.

Do anyone manage to use serverless all purpose cluster in the Databricks Free edition?

As referring to the documentation, it does mentioned that free edition do allow user to create a small serverless all purpose cluster. But in my free edition workspace, there's no option to create all purpose cluster and only serverless SQL warehouse is available.

**note: I am trying to run some pyspark code in notebook, and serverless SQL warehouse only support SQL. If free edition doesn't allow to create all purpose cluster, sounds like there's no other way to run non-SQL notebook/code in free edition.

https://docs.databricks.com/aws/en/getting-started/free-edition-limitations#compute-limitations

My Free edition workspace:

Thanks.

Re: Serverless All-purpose cluster in Free Edition

ilir_nuredini — Thu, 26 Jun 2025 11:03:08 GMT

Hello @Kai-

You can use serverless compute, and there is no need to provisioned it, Databricks handles that for you.
All what you need to do is, on the top right side, click Connect and choose Serverless, and you are good to go
to run non-SQL code notebooks.

Hope that helps. Best, Ilir

Re: Serverless All-purpose cluster in Free Edition

Kai- — Fri, 27 Jun 2025 06:45:09 GMT

Hi @ilir_nuredini,

Thanks for the suggestion, it worked!

Just sharing for information, noticed that it will prompt error when choosing Serverless in a imported notebook (tested with html and dbc). But works fine in a new notebook (with same pyspark code).

Imported via DBC:

Same code in new notebook:

Thanks.

Re: Serverless All-purpose cluster in Free Edition

Navneet670 — Mon, 28 Jul 2025 09:27:04 GMT

But in Databricks free edition, we have only serverless compute, how view spark job, spark UI ?

Re: Serverless All-purpose cluster in Free Edition

Kai- — Wed, 10 Sep 2025 06:55:13 GMT

Hi @Navneet670 ,

Is a limitation of serverless compute, spark UI is not available

https://docs.databricks.com/aws/en/compute/serverless/limitations#general-limitations

FYR, another community post that discuss about the same topic:
https://community.databricks.com/t5/get-started-discussions/is-spark-ui-available-on-the-databricks-free-edition/td-p/123148

Thanks.

Best Regards,

Kai