topic Re: How can I monitor the costs of an Azure Databricks cluster via PowerBI? in Data Engineering https://community.databricks.com/t5/data-engineering/how-can-i-monitor-the-costs-of-an-azure-databricks-cluster-via/m-p/22272#M15235 <P>There is a native&nbsp;<A href="https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-connect-azure-cost-management" alt="https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-connect-azure-cost-management" target="_blank">Cost Management Connector</A>&nbsp;in Power BI that allows one to make powerful, customized visualization and cost/usage reports. I also recommend reviewing the Chargeback/Cost Analysis section of the ADB Best Practices guide here - <A href="https://github.com/Azure/AzureDatabricksBestPractices/blob/master/toc.md#Cost-Management-Chargeback-and-Analysis" target="test_blank">https://github.com/Azure/AzureDatabricksBestPractices/blob/master/toc.md#Cost-Management-Chargeback-and-Analysis</A></P> Mon, 21 Jun 2021 19:53:46 GMT aladda 2021-06-21T19:53:46Z How can I monitor the costs of an Azure Databricks cluster via PowerBI? https://community.databricks.com/t5/data-engineering/how-can-i-monitor-the-costs-of-an-azure-databricks-cluster-via/m-p/22270#M15233 Fri, 18 Jun 2021 21:58:29 GMT https://community.databricks.com/t5/data-engineering/how-can-i-monitor-the-costs-of-an-azure-databricks-cluster-via/m-p/22270#M15233 User16137833804 2021-06-18T21:58:29Z Re: How can I monitor the costs of an Azure Databricks cluster via PowerBI? https://community.databricks.com/t5/data-engineering/how-can-i-monitor-the-costs-of-an-azure-databricks-cluster-via/m-p/22271#M15234 <P>I think Overwatch is a good option which is provided by databricks lab , which creates a data modelling in top of all logs and then powerBI can be used for monitoring the metrics.</P><P></P><P><A href="https://github.com/databrickslabs/overwatch" target="test_blank">https://github.com/databrickslabs/overwatch</A> </P> Mon, 21 Jun 2021 12:09:33 GMT https://community.databricks.com/t5/data-engineering/how-can-i-monitor-the-costs-of-an-azure-databricks-cluster-via/m-p/22271#M15234 User16826994223 2021-06-21T12:09:33Z Re: How can I monitor the costs of an Azure Databricks cluster via PowerBI? https://community.databricks.com/t5/data-engineering/how-can-i-monitor-the-costs-of-an-azure-databricks-cluster-via/m-p/22272#M15235 <P>There is a native&nbsp;<A href="https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-connect-azure-cost-management" alt="https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-connect-azure-cost-management" target="_blank">Cost Management Connector</A>&nbsp;in Power BI that allows one to make powerful, customized visualization and cost/usage reports. I also recommend reviewing the Chargeback/Cost Analysis section of the ADB Best Practices guide here - <A href="https://github.com/Azure/AzureDatabricksBestPractices/blob/master/toc.md#Cost-Management-Chargeback-and-Analysis" target="test_blank">https://github.com/Azure/AzureDatabricksBestPractices/blob/master/toc.md#Cost-Management-Chargeback-and-Analysis</A></P> Mon, 21 Jun 2021 19:53:46 GMT https://community.databricks.com/t5/data-engineering/how-can-i-monitor-the-costs-of-an-azure-databricks-cluster-via/m-p/22272#M15235 aladda 2021-06-21T19:53:46Z