topic How can I use lakehouse monitoring correctly? in Data Governance

How can I use lakehouse monitoring correctly?

Yuki — Mon, 10 Mar 2025 09:13:10 GMT

I want to try Lakehouse monitoring in Unity Catalog.
But it was failed in three table patterns.

All of the drift metrics and profile metrics are No Data.

I used the sample data "nyc taxi trips"

And I configured the details like the following image.

Re: How can I use lakehouse monitoring correctly?

koji_kawamura — Tue, 11 Mar 2025 01:10:36 GMT

Hi @Yuki

The reason you cannot see anything in the result tables is that Lakehouse monitoring only analyzes data from 30 days before its creation. Please try using a source table that has more recent timestamps.

When you first create a time series or inference profile, the monitor analyzes only data from the 30 days prior to its creation. After the monitor is created, all new data is processed.

https://docs.databricks.com/aws/en/lakehouse-monitoring/create-monitor-ui

Re: How can I use lakehouse monitoring correctly?

Yuki — Tue, 11 Mar 2025 13:58:39 GMT

Hi @koji_kawamura ,

Thank you for your prompt reply.
I'm sorry I missed to read that.

As you said, I changed the time columns recently 30 days, it has worked well.

I could understand better about it and avoid misunderstanding.

Thank you so much, I will try to utilize it.