cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

What are some possible remedies for occasional connectivity issues when using pip or dbutils.library.installPyPI?

MoJaMa
Valued Contributor II
Valued Contributor II
 
1 REPLY 1

MoJaMa
Valued Contributor II
Valued Contributor II
  1. Hosting your own internal PyPI mirror. That will allow you to manage and approve packages vs directly downloading from public PyPI and then also would remove dependency on an external service
  2. Upload all wheel files to DBFS, maybe through a CI/CD process. pip install from the DBFS path.

This is not an exhaustive list, but some possible approaches.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.