AWS DATABRICKS COMPUTE COSTS IN USAGE DASHBOARDS

Administration & Architecture

Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.

Good afternoon!

I know that the built-in Databricks usage dashboards currently only display DBU (Databricks Unit) usage. Our Databricks workspaces are running on AWS, and the clusters provision EC2 instances automatically.

I would like to include the underlying AWS EC2 costs alongside DBU usage in these dashboards.

What is the recommended approach for capturing these EC2 costs?
What is the proper way to connect this data to Databricks and incorporate it into the workspace usage dashboards?

Any guidance, best practices, or example setups would be greatly appreciated.

Thank you!