Handling Over-Usage of Capacity in Databricks Jobs/Processes

smanda88
New Contributor

Hi all,

Is there a tool or method in Databricks to ensure data integrity and stability when a job or process exceeds the allocated capacity? Specifically, I’m looking for ways to:

  1. Prevent failures or data loss due to resource overuse.
  2. Automatically scale or manage workloads efficiently.
  3. Get alerts or take preventive actions before hitting capacity limits.