Wanted to know about the cost comparison and certain specific feature details between job clusters and DLT,
Per the Pricing page (based on both Azure Pricing and Databricks Pricing page) following is the understanding - Region: US East
Provisioned
- Jobs Compute - $0.30/DBU-hour + vm cost
- DLT Core - $0.30/DBU-hour + vm cost; DLT Pro - $0.38/DBU-hour + vm cost; DLT Advanced - $0.54/DBU-hour + vm cost
Serverless (Without the limited time promotion which is valid till 31/Oct)
- Jobs Compute - $0.45/DBU-hour
- DLT - $0.45/DBU-hour
Clarifications
- DLT Serverless does not have separate pricing for different variants - looks all the features like CDC and DQ rules are packaged and available in the same version - is it correct?
- With the above costing, does this mean that notebooks executed via workflows with Job serverless compute will cost the same as the DLT serverless?
- In DLT Provisioned, there will be two clusters - updates (for performing the actual data processing) and maintenance (for performing the maintenance operations). So in case of DLT serverless as well, will it be internally running two different clusters - which will invariably result in higher cost to job clusters. Basically wanted to understand that whether DLT serverless will consume additional DBUs due to maintenance or other management overheads when compared to Jobs compute - serverless?
