cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

My cluster is running an init script, and I want to see what's going on.

brickster_2018
Databricks Employee
Databricks Employee

After I log in to the workspace, where can I find the logs?

1 ACCEPTED SOLUTION

Accepted Solutions

brickster_2018
Databricks Employee
Databricks Employee

See public docs: https://docs.databricks.com/clusters/init-scripts.html#cluster-scoped-init-script-logs

Don't forget to enable cluster log delivery: https://docs.databricks.com/clusters/configure.html#cluster-log-delivery

Note that this only works for V2 init scripts ("Cluster-Scoped", specified via API), not V1 init scripts ("Cluster-Named", specified by placing in a special location on DBFS)

View solution in original post

1 REPLY 1

brickster_2018
Databricks Employee
Databricks Employee

See public docs: https://docs.databricks.com/clusters/init-scripts.html#cluster-scoped-init-script-logs

Don't forget to enable cluster log delivery: https://docs.databricks.com/clusters/configure.html#cluster-log-delivery

Note that this only works for V2 init scripts ("Cluster-Scoped", specified via API), not V1 init scripts ("Cluster-Named", specified by placing in a special location on DBFS)

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now