Update databricks job parameter with CLI

Divya_Bhadauria — Sat, 05 Jul 2025 18:37:59 GMT

Use Case:
Updating a Databricks job with multiple tasks can be time-consuming and error-prone when changes (such as adding new parameters) need to be applied to each task manually.

Possible Solutions:

1. Using Databricks CLI – jobs reset command

You can simplify the update process by resetting the job using a modified JSON definition:

Command:

databricks jobs reset --json @path/to/reset.json
Steps:
1. In the Databricks Job UI, open the job.
2. Click the kebab menu (three dots) next to Run now and select View as Code.
3. Choose the JSON tab and select the Reset option.
4. Download the JSON definition.
5. Modify the JSON as needed (e.g., add new parameters to each task).
6. Run the CLI command above to apply the changes.

This method allows you to overwrite the entire job configuration efficiently using a single command.

2. Using Job-Level Parameters (If Same Across All Tasks)

If the new parameter is common to all tasks, consider adding it at the job level:

Go to the Job details pane and click Edit parameters.
In the Job parameters dialog, add or update parameters using the Key and Value fields.

This eliminates the need to update each task individually.

Re: Update databricks job parameter with CLI

anilsampson — Mon, 07 Jul 2025 05:09:49 GMT

hello Divya,

Could you also try YAML and update your task accordingly and deploy it as a part of asset bundles? let me know if you feel both are same?

Regards,

Anil.

topic Re: Update databricks job parameter with CLI in Data Engineering

Update databricks job parameter with CLI

1. Using Databricks CLI – jobs reset command

2. Using Job-Level Parameters (If Same Across All Tasks)

Re: Update databricks job parameter with CLI