cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Inquiry Regarding Serverless Compute Operations After Cloud Account Suspension

Harun
Honored Contributor

Hello Everyone,

I am currently benchmarking the new serverless compute feature and have observed an unexpected behavior under specific circumstances. During my benchmarking process, I executed two notebooks: one utilizing serverless compute and the other using all-purpose compute.

The notebook attached to the serverless compute completed its execution in 20 minutes, while the notebook using all-purpose compute ran for over three hours. Unfortunately, I exhausted all my Azure credits during this period.

After my Azure cloud account was disabled, I found that I could no longer create any new all-purpose compute resources, which is expected. However, I am still able to start and use serverless compute, including both notebooks and SQL Data Warehouse serverless resources. I can perform transformations and use commands like df.show() to view dataframe results, but I am unable to use df.display() or write to cloud destinations.

My question is twofold:

  1. Hosting and Operations: Where are these serverless compute resources hosted if my cloud subscription is disabled?
  2. Billing Concerns: How is the billing for these serverless compute usages handled if my account is no longer active?

I would appreciate any insights or clarifications on this.

Attaching snapshots of the serverless computes that are still operational, as well as the failure encountered when trying to create all-purpose compute resources after the cloud account was suspended

Harun_0-1723183858489.png

Harun_1-1723183868878.png

 

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group