SashankKotta
Databricks Employee
Databricks Employee

It is failing with exit status non-zero, which means the issue is in the init script file; please ensure there are no control-m chars in your init script sh file. you can run 

dos2unix <init_scrip_shell_file>

 or manually remove control-m chars in vi editor and upload. It should work.

Ideally, It is recommended to use custom compute cluster policies for any library installation instead of init scripts.

Sashank Kotta