Lakehouse monitoring metrices tables not created automatically
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-13-2025 11:56 AM
Hello,
I have an external table created in databricks unity catalog workspace and trying to "Create a monitor" for the same from quality tab.
While creating the same the dashboard is getting created however the two metrices tables "profile" & "drift" are not getting created. Can you please help to understand what could be issue here for the same.
Thank you!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-18-2025 09:24 AM
Hi Nikhil,
How are you doing today?, As per my understanding, It looks like the monitoring setup isn't fully completing, likely due to permissions, external table limitations, or system settings. First, check if your Unity Catalog schema has the right permissions, as the monitoring feature needs SELECT and WRITE access to store profile and drift metrics. If it's an external table, some monitoring features might not work as expected, so you could try converting it to a managed Delta table. Also, ensure you're using a compatible cluster—some serverless or shared clusters may not support background monitoring jobs. Lastly, check if system tables are enabled in your workspace (SHOW SYSTEM TABLES), as they are required for tracking changes. Since the dashboard is being created but the metrics tables aren't, it's likely a permissions or table compatibility issue. Let me know if you need help checking these!
Regards,
Brahma

