01-12-2024 04:09 PM
I am looking for some help on getting databricks cluster metrics such as memory utilization, CPU utilization, memory swap utilization, free file system using REST API.
I am trying it in postman using databricks token and with my Service Principal bearer token with this link
https://databricksinstance.azuredatabricks.net/?o=workspaceid#setting/clusters/cluster_id/metrics
however when i send the request it shows below sign in, is there anything else i am missing or is it not possible to view using REST API
Here is the full response.
Any suggestions?
01-13-2024 07:57 AM
There is currently no option available to get this metrics available through API, but is coming soon.
01-13-2024 07:10 PM
Thank you Walter will keep an eye for updates.
03-20-2024 12:03 AM
Is there a release calender where I can find a date for this?
04-02-2024 05:14 AM
Is there any alternative way to get all performance metrics programmatically?
04-02-2024 05:17 AM
Through Databricks REST API you can get job info such as pipeline run time, task run times etc, but I don't think you can get CPU usage and such
04-28-2024 09:05 PM
OK thank you, any plans to introduce a new feature in Databricks to capture CPU usage?
07-03-2024 02:24 AM
At my company we are also interested in this feature, is there an ETA?
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group