cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Cluster Health Dashboard

User16869510359
Esteemed Contributor

Is there a cluster health dashboard which has the details of the total number of running interactive cluster, the total number of job clusters? Also Flag clusters with issues. 

1 ACCEPTED SOLUTION

Accepted Solutions

User16869510359
Esteemed Contributor

Right now there is no inbuilt dashboard giving this information. However, it's easy to develop one using the Databricks REST API for clusters. 

List API will list the clusters and based on the STATE field we can determine if the cluster is up and running or not 

Cluster events API gives the details of the events on the cluster. This is useful to see if there are any warnings or issues on the cluster. eg: Driver unresponsive

https://docs.databricks.com/dev-tools/api/latest/clusters.html#list

View solution in original post

2 REPLIES 2

User16869510359
Esteemed Contributor

Right now there is no inbuilt dashboard giving this information. However, it's easy to develop one using the Databricks REST API for clusters. 

List API will list the clusters and based on the STATE field we can determine if the cluster is up and running or not 

Cluster events API gives the details of the events on the cluster. This is useful to see if there are any warnings or issues on the cluster. eg: Driver unresponsive

https://docs.databricks.com/dev-tools/api/latest/clusters.html#list

valeryuaba
New Contributor III

Thanks!