cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

How can I use custom python library in Azure Databricks?

Jon
New Contributor II

I am trying to access functions in my coreapi.py by importing in the main notebook, but I have error

ModuleNotFoundError: No module named 'coreapi'. I tried by uploading the file into the same folder and I tried creating a python egg and uploading it. How can i import my python library?

3 REPLIES 3

Prabakar
Esteemed Contributor III
Esteemed Contributor III

Hi @Jon, you need to install the library on the cluster. Please refer to the below document.

https://docs.databricks.com/libraries/cluster-libraries.html#install-a-library-on-a-cluster

Hubert-Dudek
Esteemed Contributor III

When you go to cluster to edit or you edit individual task you can add own library:image

-werners-
Esteemed Contributor III

There is also the possibility to use Repos file functionality:

https://databricks.com/blog/2021/10/07/databricks-repos-is-now-generally-available.html

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.