- 2644 Views
- 2 replies
- 2 kudos
While connecting the Databricks and Grafana, I have gone through the following approach.Install Grafna Agent in Databrics Clusters from Databricks console --> Not working since the system is not booted with systemd as init systemSince Spark 3 has Pro...
- 2644 Views
- 2 replies
- 2 kudos
Latest Reply
There is a repo with Prometheus gateway https://gist.github.com/Lowess/3a71792d2d09e38bf8f524644bbf8349. In the community, we usually use DataDog as both plays nicely https://docs.datadoghq.com/integrations/databricks/?tabs=driveronly
1 More Replies
- 2404 Views
- 3 replies
- 0 kudos
I would like to know if there is a way to keep track of my running streaming job.
- 2404 Views
- 3 replies
- 0 kudos
Latest Reply
Streaming metrics are available/exposed mainly through 3 ways:Streaming UI, which is available from Spark 3/DBR 7Streaming listener/Observable metrics APISpark driver logs. Search for the string "Streaming query made progress". The metrics are logged...
2 More Replies