Databricks

User16869510359 · ‎06-24-2021

After I log in to the workspace, where can I find the logs?

User16869510359 · ‎06-24-2021

See public docs: https://docs.databricks.com/clusters/init-scripts.html#cluster-scoped-init-script-logs

Don't forget to enable cluster log delivery: https://docs.databricks.com/clusters/configure.html#cluster-log-delivery

Note that this only works for V2 init scripts ("Cluster-Scoped", specified via API), not V1 init scripts ("Cluster-Named", specified by placing in a special location on DBFS)

View solution in original post

User16869510359 · ‎06-24-2021

See public docs: https://docs.databricks.com/clusters/init-scripts.html#cluster-scoped-init-script-logs

Don't forget to enable cluster log delivery: https://docs.databricks.com/clusters/configure.html#cluster-log-delivery

Note that this only works for V2 init scripts ("Cluster-Scoped", specified via API), not V1 init scripts ("Cluster-Named", specified by placing in a special location on DBFS)

Databricks

My cluster is running an init script, and I want to see what's going on.

Unity Catalog Lakeguard: Industry-first and only data governance for multi-user Apache™ Spark cluste

Announcing the General Availability of Databricks Asset Bundles

Register now and save 50% on training at Data + AI Summit!

How to successfully build GenAI applications

Meet DBRX, the New Standard for High-Quality LLMs