topic Re: Problem updating a one time run Job in Get Started Discussions

Problem updating a one time run Job

hpicatto — Sat, 17 Feb 2024 22:24:00 GMT

I'm creating a series of runs using the /api/2.1/jobs/runs/submit, I wanted to add some tags for more control on the cost and usage, but I notice it's not an option. My first idea was using /api/2.1/jobs/update but it returns that it doesn't have any job by the Id I pass. I verify the Id on the UI though. surprisingly, I cannot see the job at /api/2.1/jobs/list. I'm using the python SDK but I tried sending the request directly to the endpoint and the result is the same

Re: Problem updating a one time run Job

feiyun0112 — Sun, 18 Feb 2024 01:23:32 GMT

jobs/runs/submit submit a one-time run without creating a job. it returns `run_id`

you can Get a single job run by `/api/2.1/jobs/runs/get`

https://docs.databricks.com/api/workspace/jobs/getrun

Re: Problem updating a one time run Job

hpicatto — Sun, 18 Feb 2024 19:42:43 GMT

I know, I was not using the run I d, I was using get_run to extract the job_id and the run_page_url

Re: Problem updating a one time run Job

hpicatto — Mon, 19 Feb 2024 08:50:34 GMT

maybe updating a picture helps to ilustrate the issue:

we can see there that I can retrieve the job_id based on run_id and I've permissions over that job, but I CANNOT list jobs and cannot update as it says that the number it retrieved does not exist,

Re: Problem updating a one time run Job

feiyun0112 — Mon, 19 Feb 2024 13:00:46 GMT

I think it's by design

This endpoint allows you to submit a workload directly without creating a job

https://docs.databricks.com/api/workspace/jobs/submit

Re: Problem updating a one time run Job

hpicatto — Mon, 19 Feb 2024 13:30:13 GMT

It could be, but I can still list the job permissions, so it's creating some kind of job... Is there a way of adding from the begining/updating tags into that job?