topic Re: Databricks CLI how to start a job and pass the parameters? in Data Engineering

Databricks CLI how to start a job and pass the parameters?

jim12321 — Tue, 12 Mar 2024 18:15:34 GMT

I try to start a job ID 85218616788189 and pass one parameters 'demo' in Windows Shell.

This works:

databricks jobs run-now 85218616788189

If I try this one,

databricks jobs run-now --json '{"job_id":85218616788189,"notebook_params": {"demo":"parameter successful"}}'

What is the right syntax?

@CLI

Re: Databricks CLI how to start a job and pass the parameters?

Sravani-Vadali — Tue, 12 Mar 2024 19:53:03 GMT

Hi Jim, I think the right syntax would be something like this:

databricks jobs run-now --job-id 85218616788189 --notebook-params '{"demo":"parameter successful"}'.

Let me know if that worked!

Re: Databricks CLI how to start a job and pass the parameters?

jim12321 — Wed, 13 Mar 2024 19:39:00 GMT

Thanks for your help. I think this syntax only works for Databricks CLI (Legacy). I am using the new CLI which doesn't support the syntax.

https://docs.databricks.com/en/dev-tools/cli/commands.html

Re: Databricks CLI how to start a job and pass the parameters?

Husky — Thu, 11 Jul 2024 10:50:46 GMT

@jim12321 I got the same error with CLI version 0.223.1, but I could resolve it by escaping the quotation marks:

databricks jobs run-now --json '{\"job_id\":85218616788189,\"notebook_params\": {\"demo\":\"parameter successful\"}}'

Seems to be fixed by the databricks team with version 0.223.2 and using CLI version 0.208 your provided command works fine too.

Re: Databricks CLI how to start a job and pass the parameters?

JaviRuiz — Tue, 18 Mar 2025 14:06:29 GMT

If the job itself has parameters you have to use 'job_parameters' instead. No need for escaping as of version 0.243.0

databricks jobs run-now --json '{"job_id": <JOB_ID>, "job_parameters": {"will_exit": "yes"}}'