Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
The default storage location for driver logs in Databricks is on the local disk of the driver node. I think you can change this behavior going to cluster settings: Advanced OptionsโLoggingโDestination