Hi everyone,

I am currently building a cost-tracking dashboard, but I’ve run into a major reconciliation issue between the Azure Portal and Databricks.

The Numbers (Current Month):

• Azure Cost Management Portal: $2,041.79 (Total cost as per specific adb component).

• Databricks System Tables (Query): $3,365.959 (Calculated using system.billing.usage joined with system.billing.list_prices).

The Methodology: I am joining system.billing.usage with system.billing.list_prices on sku_name and matching the usage_start_time within the price_start_time and price_end_time windows. I am using the pricing.effective_list.default value for the calculation.

The Problem: My Databricks system table calculation cost is HIGHER than what Azure is actually billing us.

1. Negotiated Discounts: Does system.billing.list_prices reflect Enterprise Agreement (EA) or MACC discounts? Or is it strictly the public MSRP?

2. Infrastructure Costs: Typically, Azure should be higher because it includes VMs/Storage. Since my Databricks calculation is higher, does this confirm that the DBU "List Price" in the system table is ignoring our contract's negotiated unit rate?

3. Reconciliation: How are you guys handling this? Are you applying a manual "Discount Multiplier" in SQL, or is there a way to pull the "Actual Billed Price" directly into Unity Catalog?

Any insights from folks who have reconciled these two sources would be greatly appreciated!