topic Re: Running databricks job with different parameter automatically in Data Engineering

Running databricks job with different parameter automatically

Divya_Bhadauria — Mon, 01 May 2023 19:09:31 GMT

I have a python script running as databricks job. Is there a way I can run this job with different set of parameters automatically or programmatically without using run with different parameter option available in UI ?

Re: Running databricks job with different parameter automatically

Lakshay — Wed, 03 May 2023 18:39:59 GMT

You can probably get the config parameters from a file or a table which is updated after each run is completed.

Re: Running databricks job with different parameter automatically

Anonymous — Fri, 19 May 2023 05:51:28 GMT

Hi @Divya Bhadauria

We haven't heard from you since the last response from @Lakshay Goel , and I was checking back to see if her suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.