https://community.databricks.com/t5/data-engineering/jobs-with-dynamic-task-parameters/m-p/30963#M22503 <P>We have a jar method that takes in as a parameter "--date 2022-01-01" and it will process that dates worth of data. However when invoked via a job the date we want to pass in is the day before the job run was started</P><P></P><P>We could default this in the jar job itself and by default always pull yesterdays date. But this has issues when we repair a run (https://docs.databricks.com/workflows/jobs/jobs.html#repair-an-unsuccessful-job-run); If we repair it more than a day late then the date used will be incorrect. We want it to be based on when the original run took place</P><P></P><P>Is it possible to pass dynamic parameters to jobs that can utilize properties of the job run that invoked jar method?</P> Fri, 23 Sep 2022 16:22:27 GMT AlexDavies 2022-09-23T16:22:27Z https://community.databricks.com/t5/data-engineering/jobs-with-dynamic-task-parameters/m-p/30963#M22503 <P>We have a jar method that takes in as a parameter "--date 2022-01-01" and it will process that dates worth of data. However when invoked via a job the date we want to pass in is the day before the job run was started</P><P></P><P>We could default this in the jar job itself and by default always pull yesterdays date. But this has issues when we repair a run (https://docs.databricks.com/workflows/jobs/jobs.html#repair-an-unsuccessful-job-run); If we repair it more than a day late then the date used will be incorrect. We want it to be based on when the original run took place</P><P></P><P>Is it possible to pass dynamic parameters to jobs that can utilize properties of the job run that invoked jar method?</P> Fri, 23 Sep 2022 16:22:27 GMT https://community.databricks.com/t5/data-engineering/jobs-with-dynamic-task-parameters/m-p/30963#M22503 AlexDavies 2022-09-23T16:22:27Z