While connecting the Databricks and Grafana, I have gone through the following approach.

1. Install Grafna Agent in Databrics Clusters from Databricks console --> Not working since the system is not booted with systemd as init system
2. Since Spark 3 has Prometheus metrics endpoints, We can use it to add one of the data sources.
   1. Failed due to port opening. (https://dzlab.github.io/bigdata/2020/07/03/spark3-monitoring-1/)

If someone from the community working on a similar problem statement, Please guide. 😊