topic system.billing.usage table missing data for jobs running in my databricks account in Data Engineering

system.billing.usage table missing data for jobs running in my databricks account

aranjan99 — Wed, 22 May 2024 22:37:25 GMT

I have some jobs running on databricks. I can obtain their jobId from the Jobs UI or List Job Runs API.
However when trying to get DBU usage for the corresponding jobs from system.billing.usage, I do not see the same job_id in that table. Its been more than 7 days that the jobs are running but there is no data for them in billing usage table

Query I used to get the jobIds:

select distinct usage_metadata['job_id'] from system.billing.usage where usage_metadata['job_id'] is not null

I do not see the jobIds I see in UI in this table. The table is enabled and has data about other entities

Re: system.billing.usage table missing data for jobs running in my databricks account

aranjan99 — Thu, 23 May 2024 18:08:28 GMT

The jobs are completed but still not available in that table. Can you point me to how to reach out to you directly?

Re: system.billing.usage table missing data for jobs running in my databricks account

aranjan99 — Tue, 28 May 2024 18:03:17 GMT

@Retired_mod can you point me how to reach out to you? As mentioned earlier, my jobs are completed and are within last week but there is no billing data for them. Hoping you can resolve this soon

Re: system.billing.usage table missing data for jobs running in my databricks account

aranjan99 — Thu, 27 Jun 2024 22:06:47 GMT

The jobs are not long running and complete with in 30seconds. I tried restarting the compute but still not seeing any data for these jobs in the table

This spport ticket link doesnt work for me, how do I file a support ticket?