Hi @BamBam ,
In Azure Synapse Analytics (formerly SQL DW), the driver logs are not directly accessible as they are in Databricks.
However, you can access the error in SQL Pro, the driver node is not exposed to users since SQL Pro uses a managed service for the driver node. Therefore, you cannot access the driver logs directly for a SQL Pro Warehouse cluster.
When a query is run in SQL Pro, it is processed by the driver node, which then distributes the work to the worker nodes in the cluster. The driver node logs are collected by the managed service and stored on the backend in a location that is not accessible from the user interface.
That being said, you can still investigate and troubleshoot errors by using the Query Profile feature in SQL Pro. The Query Profile provides detailed information about the execution of SQL statements in your cluster, including the duration, stages, and tasks involved. To locate the full stack trace or error message for your failed query, follow these steps:
-
In SQL Pro, navigate to the "Activity" tab and select the failed query from the list.
-
Click on the "Query Profile" tab to open the query profile.
-
Scroll down to the bottom of the page to find the "Error Message" section, which contains the full error message associated with the failed query.
If you still need to access the driver logs for troubleshooting purposes, you can contact Databricks Support and they can help you get access to the managed service logs for your SQL Pro Warehouse cluster.