cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Lakehouse monitoring metrices tables not created automatically

nikhil_2212
New Contributor

Hello,

I have an external table created in databricks unity catalog workspace and trying to "Create a monitor" for the same from quality tab.

While creating the same the dashboard is getting created however the two metrices tables "profile" & "drift" are not getting created. Can you please help to understand what could be issue here for the same.

Thank you!

1 REPLY 1

Brahmareddy
Honored Contributor II

Hi Nikhil,

How are you doing today?, As per my understanding, It looks like the monitoring setup isn't fully completing, likely due to permissions, external table limitations, or system settings. First, check if your Unity Catalog schema has the right permissions, as the monitoring feature needs SELECT and WRITE access to store profile and drift metrics. If it's an external table, some monitoring features might not work as expected, so you could try converting it to a managed Delta table. Also, ensure you're using a compatible clusterโ€”some serverless or shared clusters may not support background monitoring jobs. Lastly, check if system tables are enabled in your workspace (SHOW SYSTEM TABLES), as they are required for tracking changes. Since the dashboard is being created but the metrics tables aren't, it's likely a permissions or table compatibility issue. Let me know if you need help checking these!

Regards,

Brahma

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group