Databricks Community

parallel run in job pipeline

I am trying to build a pipeline which deploys a ML model, and I want to build the pipeline in Workflow/jobs. In task of prediction of the model, I have hundreds of groups of input features, I use a for loop to get one group of input features and do ...