Hi Brahma,

thanks a lot for the help. I'm trying installing my libraries with an init script right now. Unfortunately the error does not occur very regularily, so I'll have to observer for a few days 😄

I'm not 100% happy with the solution though. We are currently setting the library version via cluster specification in the databricks-sdk, which is stored in a repo. It would be extra effort to adjust the installed library version in the init script, which can not be stored in the repo if I saw it correctly. Also seeing that Databricks advises against using init scripts for library installation I'm not fully convinced.

But if it works, it might still be the way to go. Thanks for your help!

Andreas