cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Is it possible to view Databricks cluster metrics using REST API

Prashanthkumar
New Contributor III

I am looking for some help on getting databricks cluster metrics such as memory utilization, CPU utilization, memory swap utilization, free file system using REST API.

I am trying it in postman using databricks token and with my Service Principal bearer token with this link

https://databricksinstance.azuredatabricks.net/?o=workspaceid#setting/clusters/cluster_id/metrics

however when i send the request it shows below sign in, is there anything else i am missing or is it not possible to view using REST API

Here is the full response.

Prashanthkumar_0-1705104529507.png

Any suggestions?

7 REPLIES 7

Walter_C
Honored Contributor
Honored Contributor

There is currently no option available to get this metrics available through API, but is coming soon.

Thank you Walter will keep an eye for updates.

ErikJ
New Contributor II

Is there a release calender where I can find a date for this?

Nandhini_Kumar
New Contributor III

Is there any alternative way to get all performance metrics programmatically?

Through Databricks REST API you can get job info such as pipeline run time, task run times etc, but I don't think you can get CPU usage and such

Prashanthkumar
New Contributor III

OK thank you, any plans to introduce a new feature in Databricks to capture CPU usage?

javierbg
New Contributor III

At my company we are also interested in this feature, is there an ETA?

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!