Our company is using Databricks and we are happy to have Unity Catalog emerged to solve part of our Data Governance problems. We are very interested in the Table Insights feature which is newly introduced (View frequent queries and users of a table | Databricks on AWS). We wonder if Databricks is planning to provide a REST API endpoint for exposing this information? That would be useful for our monitoring dashboard to be able to consume.
Tien Dat PHAN
Thanks for your answer. I just checked and indeed such information can be queried to information_schema tables.
Anyways, do you have the information if there exists a plan to expose such insights via REST API, or not at all?
The reason I ask because an API would be much better for our interactive dashboard using Prometheus to collect those metrics?
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!