Hi,

I tried to create a policy to use it for DLTs that are ran with shared clusters, but when i run the DLT with this policy I have an error. Init-script is added to Allowed JARs/Init Scripts.

DLT events error:

Cluster scoped init script /Volumes/main/default/bp-lakehouse-monitor/script/test-dlt.sh failed: Script exit status is non-zero

Cluster init-scripts logs error:

bash: line 11: /Volumes/main/default/bp-lakehouse-monitor/script/init_script.sh: Invalid argument

Script content:

#!/usr/bin/env bash
echo "Loading cluster init script"

Policy Family: Shared Compute
Policy Overrides:

{
"cluster_type": {
  "type": "fixed",
  "value": "dlt"
},
"init_scripts.0.volumes.destination": {
  "type": "fixed",
  "value": "/Volumes/main/default/bp-lakehouse-monitor/script/test-dlt.sh"
},
"cluster_log_conf.path": {
  "type": "fixed",
  "value": "dbfs:/cluster-logs/dlt/"
},
"cluster_log_conf.type": {
  "type": "fixed",
  "value": "DBFS"
}
}

Was anyone able to run this scenario successfully ? Thanks.