cluster metrics databricks runtime 13.1

seefoods
Valued Contributor

‎01-10-2024 12:20 AM

hello everyone, 
how to collect metrics provided by clusters metrics databricks runtime 13.1 using bash script

0 Kudos

User16539034020
Databricks Employee
Databricks Employee

‎01-11-2024 03:32 PM

Hello, 

Thanks for contacting Databricks. 

To collect metrics from Databricks Runtime 13.1 clusters using a bash script, you generally need to interact with Databricks' API. We are contemplating the introduction of a cluster metrics API that could potentially fulfill this requirement. However, this feature is still in the planning stages,  we're unable to provide an ETA yet. 

Regards,
Monica 

View solution in original post

seefoods
Valued Contributor
In response to User16539034020

‎01-16-2024 08:11 AM

Hello @User16539034020 , 
So how can i collect cluster metrics ganglia on a runtime databricks which is grater or equal than 13.1? 
cordially, 
Aubert

0 Kudos

User16539034020
Databricks Employee
Databricks Employee

‎01-17-2024 08:41 AM

hi, @Aubert:

Currently, you could only use static downloadable snapshots.
https://docs.databricks.com/en/compute/cluster-metrics.html

Regards,

0 Kudos