Hi, thank you for your response. I have a few follow-up questions to clarify best practices when it comes to passing parameters with Python files:

1. If I want to pass parameters, should I avoid using spark_python_task for Python scripts?
2. In the context of using Databricks Asset Bundles, is it generally discouraged to submit Databricks jobs using Python files (vs. notebooks)?
3. I was able to pass parameters with --python-params like --run_date 20240101 and then load them using argument parser. Is it accurate to say that spark_python_task does not support key-value parameter passing, and if so, what would you recommend if I want to maintain my project in Python files rather than notebooks while being able to pass parameters?

Thank you for your help with this!