DatabricksWorkflowTaskGroup

Nik_Vanderhoof
Contributor

Hello,

I recently learned about the DatabricksWorkflowTaskGroup operator for Airflow that allows one to run multiple Notebook tasks on a shared job compute cluster from Airflow.

Is a similar feature possible to run multiple non-Notebook tasks from Airflow on a shared job cluster? That would be of great use to us.

Thanks!