Databricks Job Params
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-10-2024 06:55 PM
Hi,
Job params override the task params(same name params). Is there a way task params override the job params.
Use case:
job params: a = "param-1".
job has 12 tasks. 10 of them should use job param(a = "param-1").
2 of them should override the job param(a = "different param -1")
- Labels:
-
Workflows
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-10-2024 07:45 PM
Hi @ajithgaade
You can use foreach Activity in Databricks workflow to achieve this.
Note - foreach Activity is in Private Preview now
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-22-2024 03:18 PM - edited 06-22-2024 03:26 PM
@Ajay-Pandey
please can you provide the doc link and sample code?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-08-2024 08:32 PM
is there any conf we can set for task params override the job params?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-09-2024 12:11 AM
Hi @ajithgaade,
Unfortunately, I don't think it is currently possible. It's clearly stated in documentation that:
" Job parameters take precedence over task parameters. If a job parameter and a task parameter have the same key, the job parameter overrides the task parameter."
