Global init script not running

[vjani]

Hello Databricks Community,

I am trying to connect databricks with datadog and have added datadog agent script in global init but it did not worked. Just to make sure if init script is working or not I have added below two lined of code in global init script.

#!/bin/bash
echo " ============== init_script ========="

After that I have restarted cluster and I do not see any output in Cluster > my-cluster> "Driver Logs" nor I am seeing any INIT_SCRIPTS_STARTED in "Event Log". What am I missing? How do I check if script files were executed or not?

Runtime: 

14.3 LTS (includes Apache Spark 3.5.0, Scala 2.12)

[szymon_dybczak · Accepted solution]

Hi @vjani ,

Global init scripts only run on clusters configured with single user or legacy no-isolation shared access mode, so Databricks recommends configuring all init scripts as cluster-scoped init scripts and managing them across your workspace using cluster policies.
So the question is, what access mode you are using in your cluster?

Use global init scripts | Databricks on AWS

[vjani]

Thanks Slash for the reply. That seems to be a reason. I was following https://docs.datadoghq.com/integrations/databricks/?tab=driveronly and missed that configuration.

[szymon_dybczak]

No problem, glad that it was helpful to you.