topic Re: Serveless compute does need has cloud accout(AWS、Google 、Azure) in Get Started Discussions

Serveless compute does need has cloud accout(AWS、Google 、Azure)

FanMichelle0729 — Fri, 14 Feb 2025 07:20:48 GMT

I am a Databricks beginner, and I would like to ask if the Compute created in the Databricks account , it means also exists in the cloud account (e.g., AWS)? If the AWS account is deactivated, the existing compute will not be usable. This is what I have observed when I use Databricks Trail version.

Re: Serveless compute does need has cloud accout(AWS、Google 、Azure)

Advika_ — Fri, 14 Feb 2025 14:08:08 GMT

Hello, @FanMichelle0729!

It depends on the type of Compute you're using in Databricks. Non-serverless compute runs in your external cloud account (e.g., AWS) and becomes unusable if that account is deactivated.

On the other hand, serverless Compute runs in a Databricks-managed environment and doesn't rely on an external cloud account (AWS, Google Cloud, Azure). This means it remains usable even if your external cloud account is deactivated.

Re: Serveless compute does need has cloud accout(AWS、Google 、Azure)

FanMichelle0729 — Sat, 15 Feb 2025 02:32:54 GMT

From Databricks architecture , the serveless compute means SQL Datawarehouse serveless ? and the classical compute means the all-purpose compute (ex. picture 2) ?

https://docs.databricks.com/en/_images/architecture.png

picture2

Re: Serveless compute does need has cloud accout(AWS、Google 、Azure)

Takuya-Omi — Sat, 15 Feb 2025 13:37:08 GMT

@FanMichelle0729

Databricks has implemented serverless capabilities not only for SQL Warehouses but also for All-Purpose Clusters, Job Clusters, and DLT.

However, in the image you attached, the All Purpose Compute tab only displays non-serverless compute options, while the SQL Warehouse tab shows both serverless and non-serverless options.

Re: Serveless compute does need has cloud accout(AWS、Google 、Azure)

FanMichelleTW — Tue, 18 Feb 2025 03:56:49 GMT

@Takuya-Omi

Thanks for replying , about the image i attached , It's my first to try Databricks and connect AWS account.

So it means when default use Databricks it will provide non-serverless (classical serveless) compute , right ?

Re: Serveless compute does need has cloud accout(AWS、Google 、Azure)

Takuya-Omi — Tue, 18 Feb 2025 15:54:40 GMT

@FanMichelleTW

No, Databricks recommends using serverless compute, and you can use serverless compute as well.

To do so, open a notebook and check the top-right corner to see if a serverless compute option is in a Ready state. If it is, simply select it, and you can start using it immediately.

The "All-Purpose Compute" tab in the compute section does not display serverless compute, but rest assured that it runs on Databricks-managed infrastructure in AWS.