cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Is it possible to view Databricks cluster metrics using REST API

Prashanthkumar
New Contributor III

I am looking for some help on getting databricks cluster metrics such as memory utilization, CPU utilization, memory swap utilization, free file system using REST API.

I am trying it in postman using databricks token and with my Service Principal bearer token with this link

https://databricksinstance.azuredatabricks.net/?o=workspaceid#setting/clusters/cluster_id/metrics

however when i send the request it shows below sign in, is there anything else i am missing or is it not possible to view using REST API

Here is the full response.

Prashanthkumar_0-1705104529507.png

Any suggestions?

7 REPLIES 7

Walter_C
Honored Contributor

There is currently no option available to get this metrics available through API, but is coming soon.

Thank you Walter will keep an eye for updates.

ErikJ
New Contributor III

Is there a release calender where I can find a date for this?

Nandhini_Kumar
New Contributor III

Is there any alternative way to get all performance metrics programmatically?

ErikJ
New Contributor III

Through Databricks REST API you can get job info such as pipeline run time, task run times etc, but I don't think you can get CPU usage and such

Prashanthkumar
New Contributor III

OK thank you, any plans to introduce a new feature in Databricks to capture CPU usage?

javierbg
New Contributor III

At my company we are also interested in this feature, is there an ETA?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group