cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

DLT Serverless costs

mbaas
New Contributor III

I recently started checking out the serverless delta live tables. In my understanding serverless continuous jobs (with autoloader) would only do something when new files arrive. However for serverless 4 pipelines running continuously, I spend in two days almost 2000 euros. Am I doing something wrong? If not, what is the benefit of using serverless continuously against a cheap single node cluster?

1 REPLY 1

NandiniN
Databricks Employee
Databricks Employee

Hi @mbaas ,

That does not sound right. So, were you able to compare the jobs, stages and spot the difference. Are there more tasks added, or with compute perspective you do not find a difference at all but only the cost? 

Also, it may be required to look at the pipelines closely to understand the reason for increased cost. Is there already an investigation support ticket open for this?

Thanks!

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now