topic Re: Custom library in clean rooms in Data Engineering

Custom library in clean rooms

adrjuju — Tue, 21 Jan 2025 09:27:34 GMT

Hello Hello !

I want to use a clean room to run some algorithms developed for one of my customer without exchanging any data, the code is stored as a python library in a private git repo connected to databricks.

1 - We'd like to import the library in the clean rooms but we cannot find how to do that any idea ? The lib is not accessible through pip

2 - Ideally, in the clean room, we'd like to keep our code secret ( for IP reasons ) do you see any way to achieve that ?

Best

Re: Custom library in clean rooms

Alberto_Umana — Tue, 21 Jan 2025 12:35:15 GMT

Hi @adrjuju,

Have you tried this approach?

!git clone https://<username>:<token>@<repository_url>.git
!pip install /path/to/cloned/repository

Re: Custom library in clean rooms

adrjuju — Wed, 22 Jan 2025 11:02:09 GMT

Thanks for the solution