Weird workflow error - Error in run but job does not exist

[Cantheman]

Hello,

I have an error: 

Job	link (116642657143475)
Job run
Task run	link (74750905368136)
Status	Failed
Started at	2025-01-14 07:48:16 UTC
Duration	2m 40s
Launched	Manually

If I try to access this job I get  :

 The job you are looking for may have been moved or deleted.

Which is correct, I have deleted that job and created a new one that is scheduled. But somehow this job gets triggered anyway and manually. I have tried getting info but in UI and through API but since job does not exist I cannot remove it . 

I deploy workflows through AZDO Devops and maybe there is a glitch between branches or something. 

Anyone seen this before?

Many thanks!

[saurabh18cs]

Redeploy the workflow and verify that the job configuration is up to date

[Cantheman]

The job has been deployed and is running fine. However this old configuration keeps running and failing. This job is in some kind of limbo. The job id does not exist but somehow gets triggered "manually". 

[saurabh18cs]

how you deleted the problematic job? 

[Walter_C]

In all the runs you see that it fails it always shows the same job id, isnt it possible that this can be triggered as a single job run via API?

[Cantheman]

@saurabh18cs I deleted the job by creating a new notebook and task. Everything is done through AZDO and I suspect that there is a glitch between the branches. 

@Walter_C  The job id only exists as a failure. The job id is always the same but does not exist in workflows in the UI or if you query the API. 

[Walter_C]

if you open another job and in the URL change the job id to this one, it also does not show anything?

[Cantheman]

Nope same, job not found. 

[Walter_C]

This is weird issue, do you have access to submit a support ticket so we can look further on it?

[Cantheman]

I will try to sync branches and re-deploy . Even weirder if I try to delete with API

/api/2.0/jobs/delete

I get: 

Failed to delete job. Status code: 403, Response: {"error_code":"PERMISSION_DENIED","message":"User  does not have Owner or Admin permissions on job 116642657143475"}

But I cannot find job with that ID with  /api/2.0/jobs/list

😀😀

[saurabh18cs]

• Review your automation scripts (e.g., Terraform, CI/CD pipelines) to ensure that they are not referencing the deleted job.
• Update the scripts to remove any references to the deleted job.

[Cantheman]

will do . Thanks