cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

cluster metrics databricks runtime 13.1

seefoods
New Contributor III

hello everyone, 
how to collect metrics provided by clusters metrics databricks runtime 13.1 using bash script

1 ACCEPTED SOLUTION

Accepted Solutions

User16539034020
Databricks Employee
Databricks Employee

Hello, 

Thanks for contacting Databricks. 

To collect metrics from Databricks Runtime 13.1 clusters using a bash script, you generally need to interact with Databricks' API. We are contemplating the introduction of a cluster metrics API that could potentially fulfill this requirement. However, this feature is still in the planning stages,  we're unable to provide an ETA yet. 

Regards,
Monica 

View solution in original post

3 REPLIES 3

User16539034020
Databricks Employee
Databricks Employee

Hello, 

Thanks for contacting Databricks. 

To collect metrics from Databricks Runtime 13.1 clusters using a bash script, you generally need to interact with Databricks' API. We are contemplating the introduction of a cluster metrics API that could potentially fulfill this requirement. However, this feature is still in the planning stages,  we're unable to provide an ETA yet. 

Regards,
Monica 

Hello @User16539034020 , 
So how can i collect cluster metrics ganglia on a runtime databricks which is grater or equal than 13.1? 
cordially, 
Aubert

User16539034020
Databricks Employee
Databricks Employee

hi, @Aubert:

Currently, you could only use static downloadable snapshots.
https://docs.databricks.com/en/compute/cluster-metrics.html

Regards,

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group