topic Re: How to pass variables to a python file job in Get Started Discussions

How to pass variables to a python file job

ducng — Mon, 02 Oct 2023 14:30:25 GMT

Hi everyone,

It's relatively straight forward to pass a value to a key-value pair in notebook job. But for the python file job however, I couldn't figure out how to do it. Does anyone have any idea?

Have been tried out different variations for a job with python file like below for example. Theoretically, I think we can add a notebook task initially in the job flow to work around. But it would be great to know a straightforward way to do this

Thank you for your time

Re: How to pass variables to a python file job

btafur — Mon, 02 Oct 2023 21:23:54 GMT

You don't need to use dbutils for this type of parameters. You can get the arguments using sys.argv. This is an example using a python wheel, but you can use it as reference: https://docs.databricks.com/en/workflows/jobs/how-to/use-python-wheels-in-workflows.html

""" The entry point of the Python Wheel """ import sys def main(): # This method will print the provided arguments print('Hello from my func') print('Got arguments:') print(sys.argv) if __name__ == '__main__': main()

Re: How to pass variables to a python file job

ducng — Wed, 04 Oct 2023 17:06:42 GMT

ah, thank you, completely forgot about that 🙂

Re: How to pass variables to a python file job

Bruno-Castro — Wed, 08 May 2024 07:37:57 GMT

Thanks so much for this! By the way, is there a way to do it with the JSON interface? I am struggling to get the parameters if entered in this way 😕