cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

system.billing.usage table missing data for jobs running in my databricks account

aranjan99
New Contributor III

I have some jobs running on databricks. I can obtain their jobId from the Jobs UI or List Job Runs API.
However when trying to get DBU usage for the corresponding jobs from system.billing.usage, I do not see the same job_id in that table. Its been more than 7 days that the jobs are running but there is no data for them in billing usage table

Query I used to get the jobIds:  

select distinct usage_metadata['job_id'] from system.billing.usage where usage_metadata['job_id'] is not null
 
I do not see the jobIds I see in UI in this table. The table is enabled and has data about other entities
 
3 REPLIES 3

The jobs are completed but still not available in that table. Can you point me to how to reach out to you directly?

@Retired_mod can you point me how to reach out to you? As mentioned earlier, my jobs are completed and are within last week but there is no billing data for them. Hoping you can resolve this soon

The jobs are not long running and complete with in 30seconds. I tried restarting the compute but still not seeing any data for these jobs in the table

This spport ticket link doesnt work for me,  how do I file a support ticket?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group