topic Re: Error: Cannot use legacy parameters because the job has job parameters configured. in Data Engineering

Error: Cannot use legacy parameters because the job has job parameters configured.

jay971 — Fri, 06 Sep 2024 04:12:27 GMT

I created a job which has two Job Parameters. How can I use Databricks CLI to pass different values to those parameters.

Re: Error: Cannot use legacy parameters because the job has job parameters configured.

Brahmareddy — Fri, 06 Sep 2024 04:28:23 GMT

Hi @jay971, How are you doing today?

To answer your question, To pass job parameters using Databricks CLI, create a JSON file that contains your job ID and parameters in the format expected by Databricks. Then, use the --json-file option in the CLI command to provide the parameters dynamically. This way, you can adjust the values for each run without changing the job itself. Also, make sure the job is set up to accept these parameters to avoid any issues during execution.

Give a try and let me know.

Regrads,

Brahma

Re: Error: Cannot use legacy parameters because the job has job parameters configured.

jay971 — Fri, 06 Sep 2024 04:49:13 GMT

Thanks for your reply, I got it working. The issue was that I was using the wrong key inside the inline JSON string. I just triggered the job.

I have a follow-up question: What is the best way to trigger the job with 10 different input parameters using the CLI? Also, my job is configured to use a job cluster. Will there be 10 different job clusters spun up? Am I correct?

Thanks Again!

Re: Error: Cannot use legacy parameters because the job has job parameters configured.

jay971 — Fri, 06 Sep 2024 05:12:24 GMT

The job ran but did not pick up the values from the CLI.