cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Is there a way so set DBU or cost limits so I don't get an unexpected bill?

jason_mcdonald
New Contributor

I'm wondering if there's a way to set a monthly budget and have my workloads stop running if I hit it.

2 REPLIES 2

brickster_2018
Databricks Employee
Databricks Employee

Currently, we do not have an option to stop the workload based on the DBU usage.

It's possible to set job timeout's to prevent pro-longed execution of jobs. The job timeout can be set to 1.5 times the normal SLA/execution time.

aladda
Databricks Employee
Databricks Employee

Cluster Policies would help with this not only from a cost management perspective but also standardization of resources across the organization as well simplification for a better user experience. You can find Best Practices on leveraging cluster policies - https://docs.databricks.com/administration-guide/clusters/policies-best-practices.html

You can also use combination of chargeback and usage logs to drive good resource usage behavior across the enterprise

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now