https://community.databricks.com/t5/data-engineering/is-there-a-way-so-set-dbu-or-cost-limits-so-i-don-t-get-an/m-p/20287#M13673 <P>Currently, we do not have an option to stop the workload based on the DBU usage. </P><P></P><P> It's possible to set job timeout's to prevent pro-longed execution of jobs. The job timeout can be set to 1.5 times the normal SLA/execution time. </P> Thu, 24 Jun 2021 23:17:22 GMT brickster_2018 2021-06-24T23:17:22Z https://community.databricks.com/t5/data-engineering/is-there-a-way-so-set-dbu-or-cost-limits-so-i-don-t-get-an/m-p/20286#M13672 <P>I'm wondering if there's a way to set a monthly budget and have my workloads stop running if I hit it.</P> Thu, 24 Jun 2021 22:46:43 GMT https://community.databricks.com/t5/data-engineering/is-there-a-way-so-set-dbu-or-cost-limits-so-i-don-t-get-an/m-p/20286#M13672 jason_mcdonald 2021-06-24T22:46:43Z https://community.databricks.com/t5/data-engineering/is-there-a-way-so-set-dbu-or-cost-limits-so-i-don-t-get-an/m-p/20287#M13673 <P>Currently, we do not have an option to stop the workload based on the DBU usage. </P><P></P><P> It's possible to set job timeout's to prevent pro-longed execution of jobs. The job timeout can be set to 1.5 times the normal SLA/execution time. </P> Thu, 24 Jun 2021 23:17:22 GMT https://community.databricks.com/t5/data-engineering/is-there-a-way-so-set-dbu-or-cost-limits-so-i-don-t-get-an/m-p/20287#M13673 brickster_2018 2021-06-24T23:17:22Z https://community.databricks.com/t5/data-engineering/is-there-a-way-so-set-dbu-or-cost-limits-so-i-don-t-get-an/m-p/20288#M13674 <P><A href="https://docs.databricks.com/administration-guide/clusters/policies.html" alt="https://docs.databricks.com/administration-guide/clusters/policies.html" target="_blank">Cluster Policies</A> would help with this not only from a cost management perspective but also standardization of resources across the organization as well simplification for a better user experience. You can find Best Practices on leveraging cluster policies - <A href="https://docs.databricks.com/administration-guide/clusters/policies-best-practices.html" target="test_blank">https://docs.databricks.com/administration-guide/clusters/policies-best-practices.html</A></P><P></P><P>You can also use combination of <A href="https://docs.databricks.com/administration-guide/account-settings/usage-detail-tags-aws.html" alt="https://docs.databricks.com/administration-guide/account-settings/usage-detail-tags-aws.html" target="_blank">chargeback</A> and <A href="https://docs.databricks.com/administration-guide/account-settings/billable-usage-delivery.html" alt="https://docs.databricks.com/administration-guide/account-settings/billable-usage-delivery.html" target="_blank">usage logs</A> to drive good resource usage behavior across the enterprise</P> Fri, 25 Jun 2021 21:35:30 GMT https://community.databricks.com/t5/data-engineering/is-there-a-way-so-set-dbu-or-cost-limits-so-i-don-t-get-an/m-p/20288#M13674 aladda 2021-06-25T21:35:30Z