How can retrieve backfill run parameter in Python?

flourishingsing
New Contributor III

‎05-20-2026 06:41 AM

flourishingsing_0-1779284296139.png

I'm trying to run backfill with the following parameter. How can I access this in the Python script?
Do I need to change anything in the yml?

I usually set task parameters the following way:

flourishingsing_1-1779284438804.png

These are then parsed using argparse Python module.

 

 

Labels:
0 Kudos

flourishingsing
New Contributor III

‎05-20-2026 07:47 AM - edited ‎05-20-2026 07:48 AM

Found the following solution:
Add job level parameters:

parameters:
  - name: run_timestamp
    default: "some_default_value"

 

Reference in task level parameters:

tasks:
  - task_key: my_task
    spark_python_task:
      python_file: ../../script.py
      parameters:
        - --run-timestamp
        - "{{job.parameters.run_timestamp}}"

 

Deploy to Databricks and override default value of job level parameter when triggering the backfill runs.

View solution in original post

0 Kudos