lprevost
Contributor III

This seems to be the key to this question:

parameterize for dlt 

 

My understanding of this is that you can add the parameter either in the DLT settings UI via Advanced Config/Add Configuration, key, value dialog.   Or via the corresponding pipeline settings JSON like this using my custom parameter "crawls_params" = "last 4".

 

"configuration": {
        "crawls_param": "last 4"
    },

 

This would require changing those setting each time you run the job.   But, I'm not clear how you would pass and subsequently read a parameter if a pipeline is added as a task to a job.   Jobs and tasks allow for passing of parameters, just not clear on how to get those into the DLT pipeline.