Cluster Health Dashboard

brickster_2018
Databricks Employee
Databricks Employee

Is there a cluster health dashboard which has the details of the total number of running interactive cluster, the total number of job clusters? Also Flag clusters with issues. 

brickster_2018
Databricks Employee
Databricks Employee

Right now there is no inbuilt dashboard giving this information. However, it's easy to develop one using the Databricks REST API for clusters. 

List API will list the clusters and based on the STATE field we can determine if the cluster is up and running or not 

Cluster events API gives the details of the events on the cluster. This is useful to see if there are any warnings or issues on the cluster. eg: Driver unresponsive

https://docs.databricks.com/dev-tools/api/latest/clusters.html#list

View solution in original post

valeryuaba
New Contributor III

Thanks!