Problem updating a one time run Job
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-17-2024 02:24 PM
I'm creating a series of runs using the /api/2.1/jobs/runs/submit, I wanted to add some tags for more control on the cost and usage, but I notice it's not an option. My first idea was using /api/2.1/jobs/update but it returns that it doesn't have any job by the Id I pass. I verify the Id on the UI though. surprisingly, I cannot see the job at /api/2.1/jobs/list. I'm using the python SDK but I tried sending the request directly to the endpoint and the result is the same
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-17-2024 05:22 PM - edited 02-17-2024 05:23 PM
jobs/runs/submit submit a one-time run without creating a job. it returns `run_id`
you can Get a single job run by `/api/2.1/jobs/runs/get`
https://docs.databricks.com/api/workspace/jobs/getrun
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-18-2024 11:42 AM
I know, I was not using the run I d, I was using get_run to extract the job_id and the run_page_url
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-19-2024 12:50 AM
maybe updating a picture helps to ilustrate the issue:
we can see there that I can retrieve the job_id based on run_id and I've permissions over that job, but I CANNOT list jobs and cannot update as it says that the number it retrieved does not exist,
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-19-2024 05:00 AM
I think it's by design
This endpoint allows you to submit a workload directly without creating a job
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-19-2024 05:30 AM
It could be, but I can still list the job permissions, so it's creating some kind of job... Is there a way of adding from the begining/updating tags into that job?