Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-09-2024 06:46 AM
The job_run_id in your SQL query represents the unique identifier for a job run within the Databricks environment. This ID is used to track and manage the execution of jobs, including those related to Clean Rooms. The job_name "clean-room-station-job-task" indicates that the job is associated with tasks executed within a Clean Room setup.
Regarding tracking overall Clean Room billing usage at an individual level, including costs for Delta Sharing, running notebooks, and expenses associated with individual collaborators, the billing mechanism involves several components:
- Resource Consumption Billing: The billing model charges the creator of the Clean Room based on the resources consumed within it. This includes serverless compute, storage, and egress costs, although currently, only serverless compute is actively monetized.
- Usage Tagging: Resources used within the Clean Room are tagged with relevant billing information, such as the payer’s workspace ID, task ID, and central clean room ID. This tagging ensures that the billing logs can attribute costs to the correct account.
- Billing Pipeline: The billing pipeline processes these logs and reroutes the charges to the creator’s workspace. This allows the creator to see the charges in their cost management page under the associated Clean Room.
- System Tables: The system.billing.usage table includes records for all billable usage across the account, which can be used to track costs at an individual level. This table aggregates resource usage on an hourly basis and includes details such as the job_run_id and other metadata.
Please refer to: https://docs.databricks.com/en/admin/system-tables/index.html