Hi there,
I've used databricks workflows to explicitly create tasks with known input parameters (either user input or default parameters). But I'm wondering, what if I want the output of one task to be a list of specific ID's (e.g. id = [7,8,10,13,27]), and then I want individual parallel tasks generated having these ID's be the new input parameters for downstream tasks.
Is this possible to implement out of the box with default Databricks Workflows (GUI)? Or for this example, would I need to leverage something like Databricks Jobs API to generate workflow tasks programmatically as per my example?
