https://community.databricks.com/t5/data-engineering/spark-submit-job-running-python-file/m-p/44030#M27593 <P>I have a spark submit job which is running one python file called main.py.</P><P>The other file is alert.py which is being imported in main.py.</P><P>Also main.py is using multiple config files.</P><P>Alert.py is passed in --py-files and other config files are passed as --files.</P><P>All the files are in S3.&nbsp;</P><P>Need help in running the same in Databricks.</P><P>Trying bt spark submit task and spark python task, not sure how to pass --py-files and --files. And even on passing these in parameters, getting no module alert found. Which means it is not recognising any other files.</P> Thu, 07 Sep 2023 17:45:50 GMT Kratik 2023-09-07T17:45:50Z https://community.databricks.com/t5/data-engineering/spark-submit-job-running-python-file/m-p/44030#M27593 <P>I have a spark submit job which is running one python file called main.py.</P><P>The other file is alert.py which is being imported in main.py.</P><P>Also main.py is using multiple config files.</P><P>Alert.py is passed in --py-files and other config files are passed as --files.</P><P>All the files are in S3.&nbsp;</P><P>Need help in running the same in Databricks.</P><P>Trying bt spark submit task and spark python task, not sure how to pass --py-files and --files. And even on passing these in parameters, getting no module alert found. Which means it is not recognising any other files.</P> Thu, 07 Sep 2023 17:45:50 GMT https://community.databricks.com/t5/data-engineering/spark-submit-job-running-python-file/m-p/44030#M27593 Kratik 2023-09-07T17:45:50Z