cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

DLT maintenance job got stuck

tomnguyen_195
New Contributor III

Hi all,

Recently we just realize a huge cost associate with our databricks account and the main culprit of it is DLT's pipeline maintenance job that got auto-scheduled to run but got stucked and cost us thousand of DBU. Do you know what would be the reason for these jobs to get stuck randomly and how to avoid this huge cost?

Thanks,

Tom

2 REPLIES 2

tinai_long
New Contributor III

Same question. These maintenance jobs run for the maximum timeout (168 hours) and do not terminate. Example below:

Screen Shot 2022-06-30 at 11.39.44 PM

do you see any issues? Could you share the full error stack trace?

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.