Cluster scoped init script failing

pablobd
Contributor II

I am creating a cluster with asset bundles and adding a init script to it with asset bundles too. The init script is a .sh file in a UC Volume. When a I run a job, the cluster spins up and fails with this error:

Cluster '****' was terminated. Reason: INIT_SCRIPT_FAILURE (CLIENT_ERROR). Parameters: instance_id:****, databricks_error_message:Cluster scoped init script /Volumes/***.sh failed: Script exit status is non-zero.

 

I enabled the login to S3 and the error logged says:

bash: line 11: /Volumes/***.sh: Permission denied


The Principal spinning the cluster has ALL PRIVILEGES granted to the volume and file. The init script is quite simple (just to test that it can run):

#!/bin/bash
printf "Hello world!!"