Can't pass dynamic parameters to non-notebook Python job (spark_python_task)

[zed]

I need to access the date of a given job running as a non-notebook Python job (spark_python_task). I want to pass a value from the cli when running it and being available to access the value in the script

I tried the approaches in the attached image when running 

bundle run my_job --params run_date=20240101

[Walter_C]

Job parameters are automatically pushed down as key-value parameters to all tasks that accept key-value parameters, which include the following task types:

• Notebook

• Python wheel (only when configured with keyword arguments)

• SQL query, legacy dashboard, or file

• Run Job