Unity Catalog: Expose REST API for Table Insights

[TienDat]

Dear community,

Our company is using Databricks and we are happy to have Unity Catalog emerged to solve part of our Data Governance problems. We are very interested in the Table Insights feature which is newly introduced (View frequent queries and users of a table | Databricks on AWS). We wonder if Databricks is planning to provide a REST API endpoint for exposing this information? That would be useful for our monitoring dashboard to be able to consume.

Best regards

Tien Dat PHAN

[Kaniz]

Hi @TienDat , There is no API for table insight for now. Search based on the tag could be done through querying information_schema.

[TienDat]

Dear @Kaniz, 

Thanks for your answer. I just checked and indeed such information can be queried to information_schema tables.

Anyways, do you have the information if there exists a plan to expose such insights via REST API, or not at all?

The reason I ask because an API would be much better for our interactive dashboard using Prometheus to collect those metrics?

Best regards

[Kaniz · Accepted solution]

Hi @TienDat , There is no API for table insight for now.