topic Re: cluster metrics collection in Data Engineering

cluster metrics collection

seefoods — Wed, 10 Jan 2024 14:17:40 GMT

Hello @Debayan please how can i collect metrics provided by clusters metrics for databricks runtime 13.1 or latest using shell bash script.
Cordially,
Aubert EMAKO

Re: cluster metrics collection

Debayan — Thu, 18 Jan 2024 04:42:44 GMT

Hi, Cluster metrics is an UI tool and available in the UI only.

For reference:

https://docs.databricks.com/en/compute/cluster-metrics.html

Re: cluster metrics collection

seefoods — Tue, 13 Feb 2024 14:10:00 GMT

Hello @Debayan ,

It's possible to query Cluster Metrics databricks for runtime which grater or equal than 13.0, because i want to colllect these metrics for a specific uses cases using bash script ? I don't want to use datadog agent.
Thanks,
Cordially,