Migrating logic from Airflow DAGs to Databricks Workflow

[jeremy98]

Hello community,
I'm planning to migrate some logics of Airflow DAGs on Databricks Workflow. But, I was facing out to some doubts that I have in order to migrate (to find the respective) the logic of my actual code from DAGs to Workflow.

There are two points:

• https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/dynamic-task-mapping...., in particular how is it possible to replicate using Workflows the .expand() function?
• How to get something like: 
  context = get_current_context() https://airflow.apache.org/docs/apache-airflow/stable/_api/airflow/operators/python/index.html#airfl...
  

[hari-prasad]

Hi @jeremy98 , you can leverage databricks dbutils.notebook.run() context to dynamically created jobs/tasks.

Refer following link for more https://docs.databricks.com/en/notebooks/notebook-workflows.html