Creating a persistent query history table using the REST API

WWoman
Databricks Partner

‎10-09-2024 12:30 PM

Hello all,

I am looking for a way to load a persistent query history table from the query history REST API (including metrics). I do know about the system table system.query.history, but I do not have access to it.

I am looking to create a python script to load this table on a daily basis. Does anyone have code they'd be willing to share?

Labels:
0 Kudos

MoJaMa
Databricks Employee
Databricks Employee

‎10-20-2024 03:34 PM

Hi,

Can you check if you have access to this?

https://github.com/dbsys21/lakehouse-tacklebox/tree/main/40-observability/dbsql-query-history-sync

Ideally your organization should enable the system tables and provide the necessary access, so each team doesn't have to reinvent the wheel.

0 Kudos