topic Re: Is it possible to view Databricks cluster metrics using REST API in Get Started Discussions

Is it possible to view Databricks cluster metrics using REST API

Prashanthkumar — Sat, 13 Jan 2024 00:09:54 GMT

I am looking for some help on getting databricks cluster metrics such as memory utilization, CPU utilization, memory swap utilization, free file system using REST API.

I am trying it in postman using databricks token and with my Service Principal bearer token with this link

https://databricksinstance.azuredatabricks.net/?o=workspaceid#setting/clusters/cluster_id/metrics

however when i send the request it shows below sign in, is there anything else i am missing or is it not possible to view using REST API

Here is the full response.

Any suggestions?

Re: Is it possible to view Databricks cluster metrics using REST API

Walter_C — Sat, 13 Jan 2024 15:57:29 GMT

There is currently no option available to get this metrics available through API, but is coming soon.

Re: Is it possible to view Databricks cluster metrics using REST API

Prashanthkumar — Sun, 14 Jan 2024 03:10:30 GMT

Thank you Walter will keep an eye for updates.

Re: Is it possible to view Databricks cluster metrics using REST API

ErikJ — Wed, 20 Mar 2024 07:03:39 GMT

Is there a release calender where I can find a date for this?

Re: Is it possible to view Databricks cluster metrics using REST API

Nandhini_Kumar — Tue, 02 Apr 2024 12:14:19 GMT

Is there any alternative way to get all performance metrics programmatically?

Re: Is it possible to view Databricks cluster metrics using REST API

ErikJ — Tue, 02 Apr 2024 12:17:35 GMT

Through Databricks REST API you can get job info such as pipeline run time, task run times etc, but I don't think you can get CPU usage and such

Re: Is it possible to view Databricks cluster metrics using REST API

Prashanthkumar — Mon, 29 Apr 2024 04:05:12 GMT

OK thank you, any plans to introduce a new feature in Databricks to capture CPU usage?

Re: Is it possible to view Databricks cluster metrics using REST API

javierbg — Wed, 03 Jul 2024 09:24:00 GMT

At my company we are also interested in this feature, is there an ETA?

Re: Is it possible to view Databricks cluster metrics using REST API

moto-charles — Wed, 15 Jan 2025 23:03:56 GMT

My company is also interested in this feature and interested in a roadmap or ETA.

Re: Is it possible to view Databricks cluster metrics using REST API

Walter_C — Thu, 16 Jan 2025 12:30:47 GMT

There is no ETA yet available, as a temporary workaround you can get metrics details via the system tables through the node_timeline

https://docs.databricks.com/en/admin/system-tables/compute.html#node-timeline-table-schema

Re: Is it possible to view Databricks cluster metrics using REST API

makulr — Mon, 17 Mar 2025 14:21:08 GMT

Hard to believe this isnt a feature yet. I mean if I can go to the cluster, click metrics and see them, why can't I get them via API??

I guess I'll go with the workaround, but this is embarrassing honestly.

Re: Is it possible to view Databricks cluster metrics using REST API

Walter_C — Mon, 17 Mar 2025 16:53:31 GMT

We understand and our product team is working on this, our direction has been to go through the system tables for this information but we are exploring in giving additional options

Re: Is it possible to view Databricks cluster metrics using REST API

Prashanthkumar — Wed, 09 Apr 2025 14:00:42 GMT

Thank you Walter, will keep an eye.

Re: Is it possible to view Databricks cluster metrics using REST API

aranjan99 — Fri, 30 May 2025 20:31:59 GMT

Is there any timeline on when will this get delivered? System tables does not give data for all clusters. Any clusters terminated within 10 minutes do not show up in that table. Its quite confusing to have the data for some clusters and missing for some

Re: Is it possible to view Databricks cluster metrics using REST API

Walter_C — Mon, 02 Jun 2025 16:38:50 GMT

As of now there is no ETA yet available

Re: Is it possible to view Databricks cluster metrics using REST API

alsetr — Tue, 22 Jul 2025 15:06:35 GMT

Hi, @Walter_C ,
thanks for suggesting solution with system tables, but it works only with Unity catalogue enabled.

Could you please advise workarounds for those who not with Unity catalogue so far?

Re: Is it possible to view Databricks cluster metrics using REST API

ajayIG — Sat, 18 Oct 2025 01:05:13 GMT

Is there any solution found to get cpu, memory metrics for Hive meta store backed workloads ? We are not using UC. So can't use system tables

Re: Is it possible to view Databricks cluster metrics using REST API

sumeet-g — Wed, 14 Jan 2026 00:09:11 GMT

@Walter_C - any updates on the feature timeline?

Re: Is it possible to view Databricks cluster metrics using REST API

Shyam_K_Reddy — Mon, 13 Apr 2026 13:58:20 GMT

@Walter_C Could you please share if there is any latest update on this ?