cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
cancel
Showing results for 
Search instead for 
Did you mean: 

Usage of SparkMetric_CL, SparkListenerEvent_CL and SparkLoggingEvent_CL

groch_adam
New Contributor

I am wondering If can retrieve any information from Azure Log Analytics custom tables (already set) for Azure Databricks. Would like to retrieve information about query and data performance for SQL Warehouse Cluster. I am not sure If I can get it from custom log analytics table (or it is only for Compute Cluster).

1 REPLY 1

Kaniz
Community Manager
Community Manager
Hi @groch_adam, Retrieving information from Azure Log Analytics custom tables for Azure Databricks is possible.
 
Let me guide you through the process.
  1. Azure Databricks Monitoring Library:

  2. Custom Log Tables in Azure Monitor:

  3. Querying Data from Azure Log Analytics:

  4. Specifically for SQL Warehouse Cluster:

    • If you’re interested in query and data performance for your SQL Warehouse Cluster, you might want to focus on specific metrics related to your workload. These could include execution times, resource utilization, and query execution plans.
    • Consider creating custom log tables that capture relevant information specific to your SQL Warehouse Cluster. You can then query these tables to gain insights into performance.

Remember to tailor your custom tables and queries to match the specific information you need for your use case. If you encounter any issues or need further assistance, feel free to ask! 😊🚀123

 

To ensure we provide you with the best support, could you please take a moment to review the response and choose the one that best answers your question? Your feedback not only helps us assist you better but also benefits other community members who may have similar questions in the future.

If you found the answer helpful, consider giving it a kudo. If the response fully addresses your question, please mark it as the accepted solution. This will help us close the thread and ensure your question is resolved.

We appreciate your participation and are here to assist you further if you need it!