Robust scheduling with dependency within Databricks?
======================================
Thanks for reviewing my threads. I like to explore Robust/complex scheduling with dependency within Databricks.
We know traditional scheduling framework allow robust dependency/conditions setting across multiple tiers etc.
How can we do that within Databricks scheduling?
Eg:
We have a HR application in tier1 - 100 jobs Start time 12AM
We have a Finance applications in tier2 - 125 jobs Start time 10AM + completion of HR applications (100 jobs)
These can be run daily or weekly.
How do we do this?
Are there any doc/whitepapers on this subject?
Thanks for your insights.
