cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

How can I use lakehouse monitoring correctly?

Yuki
New Contributor III

I want to try Lakehouse monitoring in Unity Catalog.
But it was failed in three table patterns.

All of the drift metrics and profile metrics are No Data.

Yuki_0-1741597831848.png

I used the sample data "nyc taxi trips"

Yuki_1-1741597898758.png

And I configured the details like the following image.

Yuki_2-1741597971427.png

 

1 ACCEPTED SOLUTION

Accepted Solutions

koji_kawamura
Databricks Employee
Databricks Employee

Hi @Yuki 

The reason you cannot see anything in the result tables is that Lakehouse monitoring only analyzes data from 30 days before its creation. Please try using a source table that has more recent timestamps.

 

When you first create a time series or inference profile, the monitor analyzes only data from the 30 days prior to its creation. After the monitor is created, all new data is processed.

https://docs.databricks.com/aws/en/lakehouse-monitoring/create-monitor-ui

View solution in original post

2 REPLIES 2

koji_kawamura
Databricks Employee
Databricks Employee

Hi @Yuki 

The reason you cannot see anything in the result tables is that Lakehouse monitoring only analyzes data from 30 days before its creation. Please try using a source table that has more recent timestamps.

 

When you first create a time series or inference profile, the monitor analyzes only data from the 30 days prior to its creation. After the monitor is created, all new data is processed.

https://docs.databricks.com/aws/en/lakehouse-monitoring/create-monitor-ui

Yuki
New Contributor III

Hi @koji_kawamura ,

Thank you for your prompt reply.
I'm sorry I missed to read that.

As you said, I changed the time columns recently 30 days, it has worked well.

I could understand better about it and avoid misunderstanding.

Thank you so much, I will try to utilize it.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now