Databricks Community

brickster_2018 · ‎06-24-2021

After I log in to the workspace, where can I find the logs?

brickster_2018 · ‎06-24-2021

See public docs: https://docs.databricks.com/clusters/init-scripts.html#cluster-scoped-init-script-logs

Don't forget to enable cluster log delivery: https://docs.databricks.com/clusters/configure.html#cluster-log-delivery

Note that this only works for V2 init scripts ("Cluster-Scoped", specified via API), not V1 init scripts ("Cluster-Named", specified by placing in a special location on DBFS)

View solution in original post

brickster_2018 · ‎06-24-2021

See public docs: https://docs.databricks.com/clusters/init-scripts.html#cluster-scoped-init-script-logs

Don't forget to enable cluster log delivery: https://docs.databricks.com/clusters/configure.html#cluster-log-delivery

Note that this only works for V2 init scripts ("Cluster-Scoped", specified via API), not V1 init scripts ("Cluster-Named", specified by placing in a special location on DBFS)

Databricks Community

My cluster is running an init script, and I want to see what's going on.

Join Us as a Local Community Builder!

🌟 Community Sparks of the Week | September 19 – 25 🌟

Run OpenAI Models Directly on Databricks

Solution Accelerator Series | #3 - Build Demand Forecasts at Scale

🚀 Weekly Delta (17-23 September): A Look Back at This Week’s Top Community Highlights!

Announcing Public Preview of Databricks One