cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Update databricks job parameter with CLI

Divya_Bhadauria
New Contributor III

Use Case:
Updating a Databricks job with multiple tasks can be time-consuming and error-prone when changes (such as adding new parameters) need to be applied to each task manually.

Possible Solutions:

1. Using Databricks CLI โ€“ jobs reset command

You can simplify the update process by resetting the job using a modified JSON definition:

  • Command:

     
    databricks jobs reset --json @path/to/reset.json
  • Steps:

    1. In the Databricks Job UI, open the job.

    2. Click the kebab menu (three dots) next to Run now and select View as Code.

    3. Choose the JSON tab and select the Reset option.

    4. Download the JSON definition.

    5. Modify the JSON as needed (e.g., add new parameters to each task).

    6. Run the CLI command above to apply the changes.

This method allows you to overwrite the entire job configuration efficiently using a single command.

Divya_Bhadauria_1-1751740411129.png

Divya_Bhadauria_0-1751740346442.png

 

2. Using Job-Level Parameters (If Same Across All Tasks)

If the new parameter is common to all tasks, consider adding it at the job level:

  • Go to the Job details pane and click Edit parameters.

  • In the Job parameters dialog, add or update parameters using the Key and Value fields.

This eliminates the need to update each task individually.

 

 

 

1 REPLY 1

anilsampson
New Contributor III

hello Divya, 

Could you also try YAML and update your task accordingly and deploy it as a part of asset bundles? let me know if you feel both are same?

 

Regards,

Anil.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now