Hi all,
Recently we just realize a huge cost associate with our databricks account and the main culprit of it is DLT's pipeline maintenance job that got auto-scheduled to run but got stucked and cost us thousand of DBU. Do you know what would be the reason for these jobs to get stuck randomly and how to avoid this huge cost?
Thanks,
Tom