cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Lakehouse monitoring metrices tables not created automatically

nikhil_2212
New Contributor

Hello,

I have an external table created in databricks unity catalog workspace and trying to "Create a monitor" for the same from quality tab.

While creating the same the dashboard is getting created however the two metrices tables "profile" & "drift" are not getting created. Can you please help to understand what could be issue here for the same.

Thank you!

1 REPLY 1

Brahmareddy
Honored Contributor III

Hi Nikhil,

How are you doing today?, As per my understanding, It looks like the monitoring setup isn't fully completing, likely due to permissions, external table limitations, or system settings. First, check if your Unity Catalog schema has the right permissions, as the monitoring feature needs SELECT and WRITE access to store profile and drift metrics. If it's an external table, some monitoring features might not work as expected, so you could try converting it to a managed Delta table. Also, ensure you're using a compatible cluster—some serverless or shared clusters may not support background monitoring jobs. Lastly, check if system tables are enabled in your workspace (SHOW SYSTEM TABLES), as they are required for tracking changes. Since the dashboard is being created but the metrics tables aren't, it's likely a permissions or table compatibility issue. Let me know if you need help checking these!

Regards,

Brahma

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now