DLT Serverless costs

[mbaas]

I recently started checking out the serverless delta live tables. In my understanding serverless continuous jobs (with autoloader) would only do something when new files arrive. However for serverless 4 pipelines running continuously, I spend in two days almost 2000 euros. Am I doing something wrong? If not, what is the benefit of using serverless continuously against a cheap single node cluster?

[NandiniN]

Hi @mbaas ,

That does not sound right. So, were you able to compare the jobs, stages and spot the difference. Are there more tasks added, or with compute perspective you do not find a difference at all but only the cost? 

Also, it may be required to look at the pipelines closely to understand the reason for increased cost. Is there already an investigation support ticket open for this?

Thanks!

[Kaniz_Fatma]

Hi @mbaas, Thank you for reaching out to our community! We're here to help you.

To ensure we provide you with the best support, could you please take a moment to review the response and choose the one that best answers your question? Your feedback not only helps us assist you better but also benefits other community members who may have similar questions in the future.

If you found the answer helpful, consider giving it a kudo. If the response fully addresses your question, please mark it as the accepted solution. This will help us close the thread and ensure your question is resolved.

We appreciate your participation and are here to assist you further if you need it!