Hubert-Dudek
Databricks MVP

‎01-31-2023 11:07 AM

  • You can use dbutils.notebook.run() to execute a notebook from another notebook if conditions are met in your custom logic; you can also use dbutils.jobs.taskValues to pass values between notebooks https://docs.databricks.com/workflows/jobs/how-to-share-task-values.html,
  • you can terminate notebook execution as success using dbutils.notebook.exit,
  • you can terminate the notebook as failed using standard python "raise",
  • soon new DAG will be available so that it will also be possible via UI set task execution IF/ELSE depending on the state (currently, for Azure, you can use data factory for that to set it without coding)


My blog: https://databrickster.medium.com/