topic Re: How to get the list of all jobs available for a particular user? in Data Engineering

How to get the list of all jobs available for a particular user?

Maverick1 — Thu, 16 Jun 2022 15:16:09 GMT

As of now, if I try to list the jobs via "list job" API then there is a limit of 25 jobs only.

Is there a way to list all the available/visible jobs to a user?

Re: How to get the list of all jobs available for a particular user?

User16764241763 — Fri, 17 Jun 2022 11:22:45 GMT

Hello @Saurabh Verma

Can the user generate the API token in the workspace and try to use the API?

Re: How to get the list of all jobs available for a particular user?

Maverick1 — Thu, 23 Jun 2022 16:40:48 GMT

@Kaniz Fatma @Arvind Ravish :

Yes the user can generate the API token but the limit is on the "get jobs" API level in version 2.1.

One workaround that I found is to create a while loop function and pass the offset param variable to "list job" API with value as 25.

Then reiterate and check the json response at every iteration. If the response have a key value pair as {"has_more: False"} then break the loop. Also, at every iteration, keep on appending the job_name or job_id or any other relevant info. from json response in a list.

Finally you will be having a list of all jobs that is visible to the current user.

Alternatively you can use "list job" API version 2.0. This version doesn't have the limit of 25 but it won't return the multi-tasks inside the job and has a hard limit of max 2000 jobs.