- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-19-2022 03:07 AM
We created Python package (.tar.gz) and kept it under private git.
We can able to connect to that git (using PAT) from the Azure databricks notebook.
Our requirement is to install that package from .tar.gz file for that notebook
"pip install https://USERNAME:PASWWORD@github.com/company_github/my_repo/my_package.tar.gz";
getting the below error.
does not appear to be a Python project: neither 'setup.py' nor 'pyproject.toml' found.
- Labels:
-
Azure
-
Deploy
-
Package
-
Python package
Accepted Solutions
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-20-2022 02:23 AM
For installing the package using pip you need to package the repo using setup.py. check this link for more details https://packaging.python.org/en/latest/tutorials/packaging-projects/
alternatively you can pass the tar.gz using --py-files while submitting job.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-19-2022 08:32 AM
Hello @Thushar R - My name is Piper, and I'm a moderator for Databricks. It's great to have you here and thank you for your question. 🙂
Let's give the community a while to answer before we circle back around to this.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-20-2022 02:23 AM
For installing the package using pip you need to package the repo using setup.py. check this link for more details https://packaging.python.org/en/latest/tutorials/packaging-projects/
alternatively you can pass the tar.gz using --py-files while submitting job.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-21-2022 12:12 AM
Thanks, but why do I need to build again the package?
I am using VS Code for development, through VS Code I built my package and generated tar.gz and wheel file and committed in Git. So the aim is to install the already built package from Git to Azure databricks notebook.
What I understood from your reply is, even the package exists, we have to build it again for installing, so we need the setup.py file, right?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-12-2022 08:18 AM
If i understood correctly , yes that's correct you need to use the py file. is Rahul's solution worked @Thushar R ?