Making dynamic tasks like in Airflow, but in Databricks?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-13-2025 09:50 AM
I've used Airflow which allows us to create a DAG with dynamic tasks, for example we can have a list of items (such as table names), loop through an operator that accepts a table name and create a task for each table without having to create a new notebook for each table.
Is this possible in Databricks as well?
Labels:
- Labels:
-
Workflows