https://community.databricks.com/t5/data-engineering/import-paths-using-repos-and-installed-libraries-get-confused/m-p/31458#M22902 <P>It looks for the configs locally i suppose if you can share requirements .txt i can elaborate</P> Fri, 14 Apr 2023 07:28:50 GMT Avinash_94 2023-04-14T07:28:50Z https://community.databricks.com/t5/data-engineering/import-paths-using-repos-and-installed-libraries-get-confused/m-p/31457#M22901 <P>We use Azure Devops and Azure Databricks and have custom Python libraries. I placed my notebooks in the same repo and the structure is like this:</P><P></P><PRE><CODE>mylib/ mylib/__init__.pyt mylib/code.py notebooks/ notebooks/job_notebook.py setup.py</CODE></PRE><P>Azure pipelines builds the python code into a wheel that we install in the job cluster. We also setup the job run job_notebook.py. Inside this notebook is `import mylib`.</P><P></P><P>The problem is that mylib that is used is Azure Devops copy and not the wheel that was installed. Locally, when trying to run job_notebook it won't import mylib, but in Databricks it does. Am I missing something here?</P><P></P><P>Thanks!</P> Sat, 17 Sep 2022 21:53:39 GMT https://community.databricks.com/t5/data-engineering/import-paths-using-repos-and-installed-libraries-get-confused/m-p/31457#M22901 wb 2022-09-17T21:53:39Z https://community.databricks.com/t5/data-engineering/import-paths-using-repos-and-installed-libraries-get-confused/m-p/31458#M22902 <P>It looks for the configs locally i suppose if you can share requirements .txt i can elaborate</P> Fri, 14 Apr 2023 07:28:50 GMT https://community.databricks.com/t5/data-engineering/import-paths-using-repos-and-installed-libraries-get-confused/m-p/31458#M22902 Avinash_94 2023-04-14T07:28:50Z