We use Azure Devops and Azure Databricks and have custom Python libraries. I placed my notebooks in the same repo and the structure is like this:
mylib/
mylib/__init__.pyt
mylib/code.py
notebooks/
notebooks/job_notebook.py
setup.py
Azure pipelines builds the python code into a wheel that we install in the job cluster. We also setup the job run job_notebook.py. Inside this notebook is `import mylib`.
The problem is that mylib that is used is Azure Devops copy and not the wheel that was installed. Locally, when trying to run job_notebook it won't import mylib, but in Databricks it does. Am I missing something here?
Thanks!
