topic Re: Databricks has added new metrics to its control panel, replacing the outdated Ganglia tool. These new metrics allow users to monitor the following clu... in Data Engineering

Databricks has added new metrics to its control panel, replacing the outdated Ganglia tool. These new metrics allow users to monitor the following clu...

Hubert-Dudek — Thu, 13 Apr 2023 13:48:37 GMT

Databricks has added new metrics to its control panel, replacing the outdated Ganglia tool. These new metrics allow users to monitor the following cluster performance metrics easily:

- CPU utilization

- Memory usage

- Free filesystem space

- Network traffic (received and transmitted)

- Total number of active nodes

- Total number of tasks (completed, failed, and total)

- Total task duration

- Total shuffle read write

- GPU usage

Re: Databricks has added new metrics to its control panel, replacing the outdated Ganglia tool. These new metrics allow users to monitor the following clu...

Anonymous — Tue, 25 Apr 2023 14:40:08 GMT

Thanks for sharing this @Hubert Dudek .

Re: Databricks has added new metrics to its control panel, replacing the outdated Ganglia tool. These new metrics allow users to monitor the following clu...

jose_gonzalez — Wed, 26 Apr 2023 21:42:32 GMT

Thank you for sharing @Hubert Dudek !!!