topic Install python package from private repo [CodeArtifact] in Get Started Discussions

Install python package from private repo [CodeArtifact]

pablobd — Mon, 18 Dec 2023 19:38:24 GMT

As part of my MLOps stack, I have developed a few packages which are the published to a private AWS CodeArtifact repo. How can I connect the AWS CodeArtifact repo to databricks? I want to be able to add these packages to the requirements.txt of a model logged in the model registry. Is it possible?
Thanks in advance

Re: Install python package from private repo [CodeArtifact]

pablobd — Mon, 18 Dec 2023 19:59:04 GMT

One way to do it is to run this line before installing the dependencies:
pip config set site.index-url https://aws:$CODEARTIFACT_AUTH_TOKEN@my_domain-111122223333.d.codeartifact.region.amazonaws.com/pypi/my_repo/simple/

But can we add this in MLFlow?

Re: Install python package from private repo [CodeArtifact]

pablobd — Tue, 19 Dec 2023 15:29:50 GMT

Got it! Thanks @Retired_mod . That's actually the same I do to configure the repo in my local computer. However, I need to do this in the Model Registry so that when deploying a model in the UC to model serving, it installs the requirements from my private repo. How can I run this pip config command during the deployment so that pip knows where to install the packages from?

Thanks again in advance!