Cluster Health Dashboard

[brickster_2018]

Is there a cluster health dashboard which has the details of the total number of running interactive cluster, the total number of job clusters? Also Flag clusters with issues. 

[brickster_2018 · Accepted solution]

Right now there is no inbuilt dashboard giving this information. However, it's easy to develop one using the Databricks REST API for clusters. 

List API will list the clusters and based on the STATE field we can determine if the cluster is up and running or not 

Cluster events API gives the details of the events on the cluster. This is useful to see if there are any warnings or issues on the cluster. eg: Driver unresponsive

https://docs.databricks.com/dev-tools/api/latest/clusters.html#list

[valeryuaba]

Thanks!