topic Re: Workflow timeout in Data Engineering

Workflow timeout

Hubert-Dudek — Thu, 07 Sep 2023 15:59:51 GMT

Always set a timeout for your jobs! It not only safeguards against unforeseen hang-ups but also optimizes resource utilization. Equally essential is to consider having a threshold warning. This can alert you before a potential failure, allowing proactive measures. And don’t forget to enable notifications both for threshold warnings and failed jobs.

Re: Workflow timeout

jose_gonzalez — Tue, 12 Sep 2023 17:10:59 GMT

Thank you for sharing this @Hubert-Dudek

Re: Workflow timeout

sparkplug — Mon, 14 Oct 2024 09:51:48 GMT

Hi
How do I set this as default for all users in my workspace. i.e. they shouldn't be able to run jobs for more than 24 hours

Re: Workflow timeout

Panda — Mon, 14 Oct 2024 11:57:44 GMT

@sparkplug - You can achieve this in the cluster policy by setting the job timeout_seconds to 86400.

Re: Workflow timeout

sparkplug — Mon, 14 Oct 2024 13:45:11 GMT

We already have a policy and users are using clusters created with those to run their jobs. Since the policies are not based on job compute but on Power user compute, I am not able to set the job timeout_seconds.