topic Re: Want to set execution termination time/timeout limit for job in job config in Data Engineering

Want to set execution termination time/timeout limit for job in job config

Pratibha — Sun, 07 Jan 2024 12:56:02 GMT

Hi ,

I Want to set execution termination time/timeout limit for job in job config file. please help me how I can do this by pass some parameter in job config file.

Re: Want to set execution termination time/timeout limit for job in job config

RKNutalapati — Sun, 07 Jan 2024 18:21:50 GMT

Hi @Pratibha

You can configure optional duration thresholds for a job, including an expected completion time for the job and a maximum completion time for the job. To configure duration thresholds, click Set duration thresholds.

If you are creating jobs using JOBS JSON API then you need to set the below in JSON for timeout.

Hope this helps.

Thanks,

Re: Want to set execution termination time/timeout limit for job in job config

Pratibha — Mon, 08 Jan 2024 11:20:01 GMT

yep got it but there is some additional requirement in my project I want if job take longer time then it will terminate and again it will try even if there is timeout error and in databricks launched status should show retry by scheduler and it should follow min_retry_interval_millis before start retry run.. how I can do this. I have set all parameter in config but once job gone in timeout it immidiatly start running and luanched status is not changing means it is not indicating my job is retried. please help