cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

how to load a .w2v format saved model in databricks

data_scientist
New Contributor II

Hi,

I am trying load a pre-trained word2vec model which has been saved in .w2v format in databricks. I am not able to load this file . Help me with the correct command.

1 ACCEPTED SOLUTION

Accepted Solutions

Kaniz
Community Manager
Community Manager

Hi @sonam de​ , To save models, use the MLflow functions log_model and save_model. You can also save models using their native APIs onto Databricks File System (DBFS). For MLlib models, use ML Pipelines.

To export models for serving individual predictions, you can use MLeap, a common serialization format and execution engine for machine learning pipelines. MLeap supports serializing Apache Spark, scikit-learn, and TensorFlow pipelines into a bundle, so you can load and deploy trained models to make predictions with new data. You can import the exported models into both Spark and other platforms for scoring and predictions.

Source

View solution in original post

2 REPLIES 2

Anonymous
Not applicable

Hi there and welcome to the community! My name is Piper, and I'm a moderator for the community. 🙂

Thank you for coming to us with your question. We will give it a bit to see how your peers respond and then we will circle back if we need to.

Kaniz
Community Manager
Community Manager

Hi @sonam de​ , To save models, use the MLflow functions log_model and save_model. You can also save models using their native APIs onto Databricks File System (DBFS). For MLlib models, use ML Pipelines.

To export models for serving individual predictions, you can use MLeap, a common serialization format and execution engine for machine learning pipelines. MLeap supports serializing Apache Spark, scikit-learn, and TensorFlow pipelines into a bundle, so you can load and deploy trained models to make predictions with new data. You can import the exported models into both Spark and other platforms for scoring and predictions.

Source

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.