Jobs API "run now" - How to set task wise parameters
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-11-2022 06:41 AM
I have a job with multiple tasks like Task1 -> Task2 -> Task3. I am trying to call the job using api "run now". Task details are below
Task1 - It executes a Note Book with some input parameters
Task2 - It runs using "ABC.jar", so its a jar based task with some parameters
Task3 - It runs based on "XYZ.jar", so its a jar based task with some parameters
So, how I can provide parameters to job api using "run now" command for task1,task2,task3?
- Labels:
-
JOBS
-
Jobs api
-
Multiple Tasks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-11-2022 08:29 AM
@Rama Krishna N you can refer here https://docs.databricks.com/dev-tools/api/latest/jobs.html#operation/JobsRunNow
"jar_params": [
"john",
"doe",
"35"
],
"notebook_params": {
"name": "john doe",
"age": "35"
},
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-11-2022 09:05 AM
Hi @Prabakar Ammeappin : Thanks for quick response, yeah this is good when we have Task1 and Task2 . But in my use case I have task3 as well, so how can I provide parameters for Task3 (i.e. also JAR, but not the same as Task2)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-10-2024 11:14 AM
Hi,
It would be a good feature to pass parameters at task level. We have scenarios where we would like to create a job with multiple tasks (notebook/dbt) and pass parameters at task level.