https://community.databricks.com/t5/data-engineering/how-to-send-metrics-from-gcp-databricks-to-grafana-cloud-through/m-p/16674#M10808 <P>Hi @Avinash Goje​,</P><P></P><P>Just a friendly follow-up. Did you see Hubert's response? did you have time to these these options? please let us know if you still need help or not</P> Fri, 29 Jul 2022 22:55:36 GMT jose_gonzalez 2022-07-29T22:55:36Z https://community.databricks.com/t5/data-engineering/how-to-send-metrics-from-gcp-databricks-to-grafana-cloud-through/m-p/16671#M10805 <P>While connecting the Databricks and Grafana, I have gone through the following approach.</P><OL><LI>Install <B>Grafna Agent</B> in Databrics Clusters from Databricks console --&gt; <B>Not working</B> since the system is not booted with systemd as init system</LI><LI>Since Spark 3 has Prometheus metrics endpoints, We can use it to add one of the data sources.<OL><LI>Failed due to port opening. (https://dzlab.github.io/bigdata/2020/07/03/spark3-monitoring-1/)</LI></OL></LI></OL><P></P><P>If someone from the community working on a similar problem statement, Please guide. <span class="lia-unicode-emoji" title=":smiling_face_with_smiling_eyes:">😊</span> </P> Mon, 27 Jun 2022 02:04:51 GMT https://community.databricks.com/t5/data-engineering/how-to-send-metrics-from-gcp-databricks-to-grafana-cloud-through/m-p/16671#M10805 avinash_goje 2022-06-27T02:04:51Z https://community.databricks.com/t5/data-engineering/how-to-send-metrics-from-gcp-databricks-to-grafana-cloud-through/m-p/16672#M10806 <P>There is a repo with Prometheus gateway <A href="https://gist.github.com/Lowess/3a71792d2d09e38bf8f524644bbf8349" target="test_blank">https://gist.github.com/Lowess/3a71792d2d09e38bf8f524644bbf8349</A>. </P><P></P><P>In the community, we usually use DataDog as both plays nicely <A href="https://docs.datadoghq.com/integrations/databricks/?tabs=driveronly" target="test_blank">https://docs.datadoghq.com/integrations/databricks/?tabs=driveronly</A></P> Mon, 27 Jun 2022 14:32:09 GMT https://community.databricks.com/t5/data-engineering/how-to-send-metrics-from-gcp-databricks-to-grafana-cloud-through/m-p/16672#M10806 Hubert-Dudek 2022-06-27T14:32:09Z https://community.databricks.com/t5/data-engineering/how-to-send-metrics-from-gcp-databricks-to-grafana-cloud-through/m-p/16674#M10808 <P>Hi @Avinash Goje​,</P><P></P><P>Just a friendly follow-up. Did you see Hubert's response? did you have time to these these options? please let us know if you still need help or not</P> Fri, 29 Jul 2022 22:55:36 GMT https://community.databricks.com/t5/data-engineering/how-to-send-metrics-from-gcp-databricks-to-grafana-cloud-through/m-p/16674#M10808 jose_gonzalez 2022-07-29T22:55:36Z