cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Cluster Health Dashboard

User16869510359
Esteemed Contributor

Is there a cluster health dashboard which has the details of the total number of running interactive cluster, the total number of job clusters? Also Flag clusters with issues. 

1 ACCEPTED SOLUTION

Accepted Solutions

User16869510359
Esteemed Contributor

Right now there is no inbuilt dashboard giving this information. However, it's easy to develop one using the Databricks REST API for clusters. 

List API will list the clusters and based on the STATE field we can determine if the cluster is up and running or not 

Cluster events API gives the details of the events on the cluster. This is useful to see if there are any warnings or issues on the cluster. eg: Driver unresponsive

https://docs.databricks.com/dev-tools/api/latest/clusters.html#list

View solution in original post

2 REPLIES 2

User16869510359
Esteemed Contributor

Right now there is no inbuilt dashboard giving this information. However, it's easy to develop one using the Databricks REST API for clusters. 

List API will list the clusters and based on the STATE field we can determine if the cluster is up and running or not 

Cluster events API gives the details of the events on the cluster. This is useful to see if there are any warnings or issues on the cluster. eg: Driver unresponsive

https://docs.databricks.com/dev-tools/api/latest/clusters.html#list

valeryuaba
New Contributor III

Thanks!

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.