topic Re: How to fetch runs from cluster id in api in Data Engineering

How to fetch runs from cluster id in api

talha — Thu, 25 Aug 2022 04:14:45 GMT

Task to achieve: We have cluster id and want to fetch all runs against it.

Currently I have to get all the runs, iterate through it and filter out the runs with the required cluster id.

Similarly if I want to fetch all the runs that are active?

Re: How to fetch runs from cluster id in api

Vidula — Mon, 12 Sep 2022 13:32:51 GMT

Hi @Muhammad Talha Jamil

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!

Re: How to fetch runs from cluster id in api

talha — Mon, 12 Sep 2022 17:01:43 GMT

Wasn't able to resolve but got clarification that api does not exist. Thanks

Re: How to fetch runs from cluster id in api

Debayan — Tue, 06 Sep 2022 07:26:22 GMT

Hi,

Thanks for reaching out to community.databricks.com.

You can list a single job runs running in a job-cluster through this API : https://docs.databricks.com/dev-tools/api/latest/jobs.html#operation/JobsRunsList.

If you are looking for an API for an All-purpose cluster , as of now, we do not have a cluster API (all-purpose cluster) to get all the runs in that cluster.