06-24-2021 10:38 AM
I had a job where the last step will get stuck forever. Turning on spark speculative execution did magic and resolved the issue.
Is it safe to turn on Spark speculative execution permanently.
