How to allocate costs per SQL query?

riturralde-p — Mon, 18 Dec 2023 15:55:11 GMT

By using System Tables (systen.billing.usage) I'm able to identity DBU usage per query, but I'm not able to identify who ran each query because is not part of the table.

I'm also aware of query history where all the queries and who ran them is listed.

I was thinking if it might possible to combine both to get DBU usage per user, of if you know any other way to achieve same result.

I'll greatly appreciate it.

Re: How to allocate costs per SQL query?

riturralde-p — Thu, 21 Dec 2023 13:49:36 GMT

thanks @Retired_mod for the reply, however query_id is not part of the system.billing.usage table, so no way to join them by IDs. What my Databricks account team suggested me is to join them by timestamps since both tables contain a column like that.

Also, I had to request the enablement of the Query History system table as it is still in private preview as of now.

BTW - I'm user of Azure Databricks, and if you look at AWS or GCP ones that might be the reason why you see different columns in system tables. could be the reason?.

topic How to allocate costs per SQL query? in Administration & Architecture

How to allocate costs per SQL query?

Re: How to allocate costs per SQL query?