topic Debugging jobs/run-now endpoint in Data Engineering

Debugging jobs/run-now endpoint

smpa01 — Thu, 17 Apr 2025 15:53:43 GMT

I am not being able to run jobs/runnow endpoint. I am getting an error as

Error fetching files: 403 - {"error_code":"PERMISSION_DENIED","message":"User xxxx-dxxxx-xxx-xxxx does not have Manage Run or Owner or Admin permissions on job 437174060919465","details":[{"@type":"type.googleapis.com/google.rpc.RequestInfo","request_id":"4f01cd16-ed00-4b2b-bc4d-6f24a0ca76a9","serving_data":""}]}

But I am clearly the owner, what could be possibly causing this

Thank you in advance.

Re: Debugging jobs/run-now endpoint

Renu_ — Fri, 18 Apr 2025 14:05:20 GMT

Hi @smpa01, make sure the API token or authentication you're using is linked to the account that has the necessary permissions on the job. You can also try running the job directly from the Databricks UI, if it works there but not via the API, it indicates an issue with the authentication or token.

If the issue still persists, I’d recommend, reach out to Databricks Support for further investigation.

Re: Debugging jobs/run-now endpoint

RiyazAliM — Mon, 21 Apr 2025 07:15:42 GMT

Hi @smpa01 - The PAT you're using belongs to Service Principal or your personal token? If SP, it should have permissions to run the DBX workflow.

Let me know if any questions.

Re: Debugging jobs/run-now endpoint

smpa01 — Tue, 22 Apr 2025 13:57:54 GMT

When I run via UI, it runs error free. But I can't run it through API, which I need for advanced workflow orchestration.

Re: Debugging jobs/run-now endpoint

RiyazAliM — Thu, 24 Apr 2025 11:04:29 GMT

Hey @smpa01 - when you run via the UI, it's you (user) who run the workflow, and it's estabished that you're the owner of the workflow, so no issues there. The PAT does it belongs to you or a SP? that's where the issue is, if the PAT token is for a SP, try adding that service principal to the permissions with atleast run permissions. This should resolve the issue.

Let me know your thoughts.