- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
4 weeks ago
I am looking at a scenario for team-level cost attribution using system.billing.usage and have a tagging gap for Databricks-managed services such as Predictive Optimization and Data Quality Monitoring.
Tried adding a team/ownership tag directly to the underlying Unity Catalog table, expecting that when Predictive Optimization or Data Quality Monitoring operates on that table, the tag would propagate to the corresponding billing usage.
However, it's not the reflected in : system.billing.usage.custom_tags
Usage can be identified with:
SELECT
usage_date,
billing_origin_product,
sku_name,
usage_metadata.schema_id,
custom_tags,
usage_quantity
FROM system.billing.usage
WHERE billing_origin_product IN (
'PREDICTIVE_OPTIMIZATION',
'DATA_QUALITY_MONITORING',
'LAKEHOUSE_MONITORING'
)
ORDER BY usage_date DESC;Trying to determine whether the following attribution flow is supported:
UC Table
team = "team-a"
↓
Predictive Optimization / DQ Monitoring
↓
Databricks-managed compute
↓
system.billing.usage.custom_tags
team = "team-a"Is propagation of catalog/schema/table tags into billing usage supported for these services?
If not, what could be the recommended way to attribute Predictive Optimization and Data Quality Monitoring costs back to the team owning the underlying table/schema?
We are currently considering a separate object-to-team mapping for cost attribution (Kind of mapping table), but wanted to check whether there is a native/supported mechanism before doing so.