โ12-18-2022 09:27 PM
Is there a way to schedule a job to run after some other job is complete?
E.g. Schedule Job A, then upon it's completion run Job B.
โ12-21-2022 01:21 AM
There is an upcoming preview where you can run a Job as a Task and then you can chain one job after another one.
โ12-18-2022 10:45 PM
Hi @_ _โ yes you can do the same, but you have to use workflow API to trigger another Job
โ12-18-2022 10:46 PM
โ12-19-2022 03:53 PM
Hi, I am aware you can add multiple tasks to a job, but this is not the question I have asked
โ12-19-2022 12:20 AM
@_ _โ you can create two tasks in the Jobs section. Second job runs only after the first job is done.
โ12-19-2022 03:55 PM
Hi, I am aware you can add multiple tasks to a single job, but this is not the question I have asked
โ12-21-2022 01:21 AM
There is an upcoming preview where you can run a Job as a Task and then you can chain one job after another one.
โ12-21-2022 02:40 PM
Sounds great, I will look out for it
โ04-18-2023 01:35 AM
I can't find this anywhere, has it been released yet? Or is planned to still?
โ05-17-2023 02:23 AM
@Youssef Mriniโ any update if this feature is now available in Databricks
โ05-17-2023 02:30 AM
It will be available soon in a public preview. It has been announced at the roadmap webinar
โ06-02-2023 04:07 AM
is there any tentative date? very useful feature.
โ12-21-2022 09:48 PM
You can add dependency task under tasks section of Job. Dependency task is another databricks job
โ01-06-2023 02:51 AM
For now guess calling tasks individually is the only option - or maybe call the relevant notebooks in a separate notebook with each cell calling on a notebook ?
โ01-06-2023 02:51 AM
On the different note, I hope databricks introduces failure dependency in its workflow i.e. call a job if the dependent job fails and custom e-mail with attachments...
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group