I built Databricks Cost Observability โ a full-stack observability dashboard
that runs natively as a Databricks App and reads directly from system tables.
No data leaves your workspace, no external BI tools needed.
What it covers across 11 tabs:
โข Executive spend KPIs + AI_FORECAST() contract-year projection
โข ML-powered anomaly detection (Isolation Forest) with cost impact
โข Compute right-sizing โ clusters, warehouses, DBR version sprawl
โข Per-user query attribution with 30/60/90-day cost breakdown
โข AI Gateway token usage by model (GPT-4, Claude, Mixtral, LLaMA, DBRX)
โข Unity Catalog permission graph (interactive โ users, groups, SPs, catalogs)
โข Job SLA tracking โ success rates, failure trends, DLT pipeline health
โข Data lineage (bronzeโsilverโgold), MLflow, model registry
Works on free-tier workspaces via MOCK_MODE โ no system table access needed.
Deploys in one git push via GitHub Actions + Databricks Asset Bundle.
GitHub: https://github.com/vijayakunuri1/databricks-cost-observability
Would love feedback โ especially from AWS/GCP/Azure users. Happy to take feature
requests via GitHub Issues.