Can't pass dynamic parameters to non-notebook Python job (spark_python_task)
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-05-2024 01:59 AM
I need to access the date of a given job running as a non-notebook Python job (spark_python_task). I want to pass a value from the cli when running it and being available to access the value in the script
I tried the approaches in the attached image when running
bundle run my_job --params run_date=20240101
Labels:
- Labels:
-
Workflows