Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-13-2024 10:21 AM
As per docs it seems that pipeline task type is currently not supported to pass parameters: https://docs.databricks.com/en/jobs/create-run-jobs.html#pass-parameters-to-a-databricks-job-task
You could create a notebook task that runs before your pipeline task. This notebook task would take the job parameters and write them to a location accessible by your pipeline task, such as DBFS (Databricks File System) or a database. Then, your pipeline task could read these parameters from that location.