Databricks has added new metrics to its control panel, replacing the outdated Ganglia tool. These new metrics allow users to monitor the following clu...

Hubert-Dudek
Databricks MVP

Databricks has added new metrics to its control panel, replacing the outdated Ganglia tool. These new metrics allow users to monitor the following cluster performance metrics easily:

- CPU utilization

- Memory usage

- Free filesystem space

- Network traffic (received and transmitted)

- Total number of active nodes

- Total number of tasks (completed, failed, and total)

- Total task duration

- Total shuffle read write

- GPU usage

Screenshot 2023-04-13 154026


My blog: https://databrickster.medium.com/

Anonymous
Not applicable

Thanks for sharing this @Hubert Dudek​ .

jose_gonzalez
Databricks Employee
Databricks Employee

Thank you for sharing @Hubert Dudek​ !!!