unity catalog system.access.audit lag

[angel_ba]

Hello,

We have unity catalog enabled workspace. To get the completion time of a pipeline that runs multiple times a day, I am  checking system.access.audit table. Comparing the completion time of the pipeline compared to other pipeline time I am creating an alert. But I noticed the audit table has a lag of about 15 minutes i.e. the table dooesn't get updated until after about 15 minutes and as a result a false alert gets raised. How the lag can be handled?

Thanks

Bhawana

[daniel_sahal]

@angel_ba 
System tables are still in public preview thus there are some limitations, one of them is a blocker for your use case.

Currently no support for real-time monitoring. Data is updated throughout the day. If you don’t see a log for a recent event, check back later.

https://docs.databricks.com/en/administration-guide/system-tables/index.html#known-issues