I have a Foundation Model provisioned throughput endpoint with 50 provisioned model units. It is READY but has received zero inference requests. Yet system.billing.usage shows DBUs accruing continuously from creation.
-- Cost is accruing
WITH usage_agg AS (
SELECT usage_date, sku_name, usage_unit,
SUM(usage_quantity) AS total_dbus
FROM system.billing.usage
WHERE workspace_id = '<workspace_id>'
AND usage_metadata.endpoint_id = '<endpoint_id>'
GROUP BY 1, 2, 3
),
prices AS (
SELECT sku_name, usage_unit,
pricing.effective_list.default AS price_per_dbu
FROM system.billing.list_prices
WHERE price_end_time IS NULL
)
SELECT u.usage_date, ROUND(u.total_dbus, 4) AS total_dbus,
ROUND(u.total_dbus * p.price_per_dbu, 4) AS cost_usd
FROM usage_agg u
LEFT JOIN prices p ON u.sku_name = p.sku_name AND u.usage_unit = p.usage_unit
ORDER BY 1;
-- But zero requests
SELECT COUNT(*) FROM system.serving.endpoint_usage
WHERE served_entity_id = '<served_entity_id>';
-- Reserved capacity not visible in system tables
SELECT endpoint_name,
foundation_model_config.min_provisioned_throughput,
foundation_model_config.max_provisioned_throughput
FROM system.serving.served_entities
WHERE endpoint_id = '<endpoint_id>';
Both fields return null, even though the endpoint is actively provisioned and billing.
Looks like (not sure) it is costing for the minimum tokens (reserved capacity). Where in system tables can I find the reserved capacity (provisioned model units or DBU rate) for a foundation model PT endpoint? How can we attribute it to usage and billing? Any supporting documentation or materials?