How to create a raw data (with filter_by) to pull query history from now to 5 mins ago

[Chinu]

Hi Team,

Is it possible I can use "query_start_time_range" filter from the api call to get the query data only from now to 5 mins ago?

Im using telegraf to call query history api but it looks like Im reaching the max return and I can't find how to use the pagination from telegraf.

My idea is running telegraf every 5 min and get the query history for the last 5 mins.

Thanks for the help.

Chinu Lee

[mathan_pillai · Accepted solution]

Have you checked this https://docs.databricks.com/api-explorer/workspace/queryhistory/list you can list the queries based on time range as well. So you can try passing the fields in the filter_by parameter. Then pass the value as (current time - 5 min)