Schedule job to run sequentially after another job

[deep_thought]

Is there a way to schedule a job to run after some other job is complete?

E.g. Schedule Job A, then upon it's completion run Job B.

[Ajay-Pandey]

Hi @_ _​ yes you can do the same, but you have to use workflow API to trigger another Job

[Harun]

Hi @_ _​ ,

Under the job section, create your first task, then add dependent task (attached snapshot for your reference).

 

[deep_thought]

Hi, I am aware you can add multiple tasks to a job, but this is not the question I have asked

[Geeta1]

@_ _​ you can create two tasks in the Jobs section. Second job runs only after the first job is done.

[deep_thought]

Hi, I am aware you can add multiple tasks to a single job, but this is not the question I have asked

[youssefmrini · Accepted solution]

There is an upcoming preview where you can run a Job as a Task and then you can chain one job after another one.

[deep_thought]

Sounds great, I will look out for it

[DBedrenko]

I can't find this anywhere, has it been released yet? Or is planned to still?

[mickniz]

@Youssef Mrini​  any update if this feature is now available in Databricks

[youssefmrini]

It will be available soon in a public preview. It has been announced at the roadmap webinar

[Rajeev_Basu]

is there any tentative date? very useful feature.

[ramravi]

You can add dependency task under tasks section of Job. Dependency task is another databricks job

[ranged_coop]

For now guess calling tasks individually is the only option - or maybe call the relevant notebooks in a separate notebook with each cell calling on a notebook ?

[ranged_coop]

On the different note, I hope databricks introduces failure dependency in its workflow i.e. call a job if the dependent job fails and custom e-mail with attachments...