topic Re: Unable to enable Serverless Notebooks in Administration & Architecture

Unable to enable Serverless Notebooks

akmukherjee — Fri, 27 Dec 2024 14:19:16 GMT

Hello there,

I have a Databricks Premium Subscription but am not able to enable Serverless Notebooks (as that option does not seem to exist). I have gone through DB documentation and have Unity Catalog Enabled. I even opened a ticket (00591635) but it was closed and I was asked to open a new one here. I purchased DB through the AWS marketplace. I had the exact same observation in Azure. I followed ALL the documentation and I am able to create jobs, compute, run notebooks etc. I do NOT see the Serverless Options in the Feature Enablement Tab as documented (with no explanation either). ANY assistance would be most appreciated as taking 10min to start a cluster is quite prohibitive from a learning perspective for off work hours learner.

Re: Unable to enable Serverless Notebooks

Walter_C — Fri, 27 Dec 2024 14:27:51 GMT

can you please provide me an screenshot of the Feature enablement part of your Account Console? The region where your workspace resides and the workspace id please?

Re: Unable to enable Serverless Notebooks

akmukherjee — Fri, 27 Dec 2024 15:59:53 GMT

Here it it Walter. Appreciate the response.

Re: Unable to enable Serverless Notebooks

Walter_C — Fri, 27 Dec 2024 17:52:40 GMT

When you access a notebook and try to select the cluster it does not show the option for serverless by default?

Re: Unable to enable Serverless Notebooks

Walter_C — Fri, 27 Dec 2024 17:53:43 GMT

Databricks has started making serverless compute for notebooks, jobs, and Delta Live Tables available by default on eligible accounts, beginning with accounts on the Premium plan or above.

Re: Unable to enable Serverless Notebooks

akmukherjee — Fri, 27 Dec 2024 18:40:22 GMT

Yes, but for some reason it does not do that on my account. Please see screenshot below. I saw this on both AWS and Azure.

Re: Unable to enable Serverless Notebooks

Walter_C — Fri, 27 Dec 2024 20:03:40 GMT

Can you confirm unity Catalog is enabled, can you share an screenshot also of your catalog explorer?

Re: Unable to enable Serverless Notebooks

akmukherjee — Fri, 27 Dec 2024 20:25:15 GMT

Here is an image of the Catalog Explorer and a sample Catalog.

Re: Unable to enable Serverless Notebooks

Walter_C — Fri, 27 Dec 2024 21:05:13 GMT

Seems that you have all requirements and your workspace is hosted in a supported region, when you click on More on the option to select the cluster on the notebook it does not show any Serverless option?

Re: Unable to enable Serverless Notebooks

akmukherjee — Fri, 27 Dec 2024 21:26:27 GMT

It does not show be a Serverless Notebook Option but shows me a Serverless Warehouse Option when I click Create Resource. as shown below.

Re: Unable to enable Serverless Notebooks

Walter_C — Sat, 28 Dec 2024 03:42:13 GMT

On your browser can you please run the following url: https://<workspace_url>/config and search for serverlessClustersEnabled and let me know if it shows true or false.

Re: Unable to enable Serverless Notebooks

akmukherjee — Sat, 28 Dec 2024 15:46:39 GMT

It shows true as seen below.

Re: Unable to enable Serverless Notebooks

Walter_C — Mon, 30 Dec 2024 14:40:15 GMT

Ok allow me with some time to check on this with my internal team. During the time do you have any other workspace that can be used to test?

Re: Unable to enable Serverless Notebooks

akmukherjee — Mon, 30 Dec 2024 14:50:31 GMT

I have another workspace on Azure, but it shows the exact same behavior.

Re: Unable to enable Serverless Notebooks

Walter_C — Mon, 30 Dec 2024 14:55:51 GMT

I have a conversation with internal teams regarding this and they have mentioned that as this is a recently created account it could take 2 weeks to show the serverless options on it but I am looking to get the confirmation.

Re: Unable to enable Serverless Notebooks

akmukherjee — Mon, 30 Dec 2024 15:39:38 GMT

This is really unfortunate. It would go past the trial period in that case which seems to be 14 days.

Re: Unable to enable Serverless Notebooks

Walter_C — Tue, 31 Dec 2024 14:36:36 GMT

Our team has confirmed this might be available by next week.

Re: Unable to enable Serverless Notebooks

akmukherjee — Tue, 31 Dec 2024 15:26:33 GMT

Thanks Walter. Will wait for that.

Re: Unable to enable Serverless Notebooks

akmukherjee — Mon, 06 Jan 2025 14:54:55 GMT

Hey Walter, I seem to have the Serverless Option but it seems to be enabled AFTER the trial period. Is that a deliberate decision and if so it is quite unfortunate as this is REALLY one of the best features of DB ecosystem.

Re: Unable to enable Serverless Notebooks

Walter_C — Mon, 06 Jan 2025 15:06:08 GMT

it seems it is not specific to trial mode, as per the information I received from Engineering team, it seems that for new created accounts it can take up to 15 days to have serverless enabled on their workspaces. This will probably be improved in the future.