topic Re: How to enable Delta live tables serverless in Databricks? in Data Engineering

How to enable Delta live tables serverless in Databricks?

nggianno — Fri, 01 Mar 2024 14:21:26 GMT

I am trying to enable the Serverless mode in the Delta Live Tables, based on what the official Databricks channel YouTube video "Delta Live Tables A to Z: Best practices for Modern Data Pipelines".And I cannot find it in my UI. Could you help me with that? How is it possible to enable?

Re: How to enable Delta live tables serverless in Databricks?

Kayla — Fri, 01 Mar 2024 15:46:41 GMT

Are you on GCP by chance? If so, I don't think serverless options are available yet.

Re: How to enable Delta live tables serverless in Databricks?

nggianno — Fri, 01 Mar 2024 15:50:51 GMT

No, I am in AWS.

Re: How to enable Delta live tables serverless in Databricks?

nggianno — Mon, 04 Mar 2024 08:33:59 GMT

The problem is that the "Serverless" checkbox does not appear in my UI Pipeline Settings. So, I do not know how to enable serverless given your instructions. Can you tell me why the button is not displayed or how to display it or how to enable DLT serverless with another way?

Re: How to enable Delta live tables serverless in Databricks?

kols — Mon, 13 May 2024 13:52:39 GMT

Serverless DLT pipelines are currently in PrPr (Private Preview).
Thus, you will not see this checkbox if you are not part of this PrPr.
To learn about enabling Serverless DLT pipelines, contact your Databricks account team.

Re: How to enable Delta live tables serverless in Databricks?

Daan — Mon, 21 Oct 2024 15:48:20 GMT

I am facing the same issue. Is this still not available to the public?

Re: How to enable Delta live tables serverless in Databricks?

kols — Mon, 21 Oct 2024 16:17:54 GMT

It is generally available in supported regions and needs to be enabled by an account admin (if not auto-enabled): Enable serverless compute

Re: How to enable Delta live tables serverless in Databricks?

Daan — Mon, 21 Oct 2024 19:42:33 GMT

Hey Kols, thanks for the reply. I am the account admin and I had already serverless compute enabled and our platform is hosted on AWS eu-central-1. As far as I can tell from the documentation every requirement is met to enable serverless DLT pipelines.

Re: How to enable Delta live tables serverless in Databricks?

kols — Tue, 22 Oct 2024 06:57:42 GMT

It's available in your region. Only other requirement is that the workspace needs to have Unity Catalog enabled - is that the case as well?
Otherwise please contact your Databricks account team or open a support ticket.

Re: How to enable Delta live tables serverless in Databricks?

Daan — Tue, 22 Oct 2024 08:39:50 GMT

Hey Kols,

Unity catalog is enabled as well, as you can see in the screenshot. To open a support ticket I need dedicated Databricks support which our company doesn't have.