saurabh18cs
Honored Contributor III

Hi @aliz Either go serverless as this will reduce cluster starup time or keep controlling your compute via job cluster but specify libraries for all tasks.