Louis_Frolio
Databricks Employee
Databricks Employee

Is it serverless or classic jobs compute?  Also, if it were me I would try with a different runtime (LTS of course) to see if the problem exists there (assuming you are not using serverless). e.g 14.3 LTS, 13.3 LTS, 12.3 LTS, etc.  It might help you understand where the conflict is happening.  Cheers, Lou.