cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

My cluster is running an init script, and I want to see what's going on.

brickster_2018
Esteemed Contributor

After I log in to the workspace, where can I find the logs?

1 ACCEPTED SOLUTION

Accepted Solutions

brickster_2018
Esteemed Contributor

See public docs: https://docs.databricks.com/clusters/init-scripts.html#cluster-scoped-init-script-logs

Don't forget to enable cluster log delivery: https://docs.databricks.com/clusters/configure.html#cluster-log-delivery

Note that this only works for V2 init scripts ("Cluster-Scoped", specified via API), not V1 init scripts ("Cluster-Named", specified by placing in a special location on DBFS)

View solution in original post

1 REPLY 1

brickster_2018
Esteemed Contributor

See public docs: https://docs.databricks.com/clusters/init-scripts.html#cluster-scoped-init-script-logs

Don't forget to enable cluster log delivery: https://docs.databricks.com/clusters/configure.html#cluster-log-delivery

Note that this only works for V2 init scripts ("Cluster-Scoped", specified via API), not V1 init scripts ("Cluster-Named", specified by placing in a special location on DBFS)

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group