I feel that the challenges will be far more due to the limitations of the workflow & Databricks. For example- How to install the libraries dynamically to the cluster etc. And also this type of framework should not be called as ETL framework. Because ...
