Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-17-2022 01:30 AM
These features are amazing and we do use these to optimize individual queries
But I was looking for a way where we can calculate statistics over all the queries running on the platform. Answer questions like
- Who is running the most queries
- What is the average query execution time
- What tables are being used the most/least
The information required to service these queries is available in the query history tab, but in its current form its impossible to run aggregation queries over of top of that data. I was looking to see if that data could easily be exposed as a table in databricks
But, as it doesn't appear possible, we are writing something custom to export query history from the API and import it into a table