How to add shared libs

[Brad]

Hi team,

I want to add some shared libs which might be used by many repos, e.g. some util functions which might be used by any repos.

1. What is the recommended way to add those libs? E.g. create a separate repo and reference it in another repo?

2. How to control the permission? 

3. How to control diff versions?

4. How to share from diff workspaces?

Thanks

[Alberto_Umana]

Hi @Brad,

You can use cluster libraries so whenever interacting with repos libraries are available. Also the cluster can be shared to others. https://docs.databricks.com/en/libraries/cluster-libraries.html.

About permissions you can control them over cluster permissions too. 

[Brad]

Hi @Alberto_Umana , thanks for response. What if each job is using a job cluster?

[radothede]

Hi @Brad 

Typically, You specify shared libraries in init script. From there, init script will be executed for each job compute, ensuring lib consistency.

The other way - You could use a job cluster policy and specify desired libraries that will be provided during the cluster setup.

Best,

Rado.