Handling Over-Usage of Capacity in Databricks Jobs/Processes
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-17-2025 07:02 AM
Hi all,
Is there a tool or method in Databricks to ensure data integrity and stability when a job or process exceeds the allocated capacity? Specifically, I’m looking for ways to:
- Prevent failures or data loss due to resource overuse.
- Automatically scale or manage workloads efficiently.
- Get alerts or take preventive actions before hitting capacity limits.