Where are driver logs for SQL Pro Warehouse?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-11-2023 11:49 AM
In an All-Purpose Cluster, it is pretty easy to get at the Driver logs. Where do I find the Driver Logs for a SQL Pro Warehouse? The reason I ask is because sometimes in a SQL Editor we get generic error messages like "Task failed while writing rows to abfss://...". I am guessing the rest of the error message (i.e. full stack error) is in the Spark driver log. Where are those driver logs located in SQL Pro Warehouse?
I was just in a Databricks Open Office Hours webinar and Clayton mentioned you can find this in the Query Profile. I looked at the query profile and the 3 dots at the top-right corner only have the option to "Download" which downloads the query profile as JSON.