- 2750 Views
- 2 replies
- 0 kudos
Access Ganglia metrics via endpoint
How to access the raw Ganglia metrics. Is there an endpoint or a DBFS storage it belongs to?
- 2750 Views
- 2 replies
- 0 kudos
- 1630 Views
- 1 replies
- 1 kudos
- 1630 Views
- 1 replies
- 1 kudos
- 1 kudos
Ganglia metrics are available only if the job runs for more than 15 minutes. For jobs that are completed within 15 minutes, the metrics won't be available
- 1 kudos
- 2407 Views
- 1 replies
- 0 kudos
Extending the duration of Ganglia metrics logs
Any insights on how to analyse Ganglia Metrics logs for an extended duration of time, not just 15 minute snapshots? We need to visualize cluster CPU utilization for the duration of cluster uptime
- 2407 Views
- 1 replies
- 0 kudos
- 0 kudos
One option here would be integration with Observability tools such as Datadog which can capture the cluster metrics on a more NRT basis. More details are here - https://docs.datadoghq.com/integrations/databricks/?tab=driveronly
- 0 kudos