cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
cancel
Showing results for 
Search instead for 
Did you mean: 

Loading model file on databrick

PareDesa_10157
New Contributor II

Hello,

I am having hard time loading certain model of python (scispacy model)

I want to load the model on the location so i can call it on the code running in databrick python notebook

wanted to load the model file (zipped)

How can I load it on the cluster so iccan mention that

spacy.load(what-do-I-put-here/filename)

Thanks

2 REPLIES 2

Kaniz
Community Manager
Community Manager

Hi @Paresh Desai​, You can follow the below steps to install and load spaCy package on Azure Databricks.

Step 1: Install spaCy using pip and download the spaCy models.

%sh
/databricks/python3/bin/pip install spacy 
/databricks/python3/bin/python3 -m spacy download zipped

import spacy
 
nlp = spacy.load("/dbfs/path/to/your/model/")

Anonymous
Not applicable

Hi @Paresh Desai​ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.