cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

ptawil
by New Contributor III
  • 1781 Views
  • 2 replies
  • 2 kudos

Model Serving Status Failed

I'm trying to enable serving for my model but I keep getting Pending into Failed Status.Here are the model event logs.2022-11-15 15:43:13ENDPOINT_UPDATEDFailed to create model 3 times2022-11-15 15:43:03ENDPOINT_UPDATEDFailed to create cluster 3 times...

  • 1781 Views
  • 2 replies
  • 2 kudos
Latest Reply
171499
New Contributor III
  • 2 kudos

Any update on this? I'm running into the same issue

  • 2 kudos
1 More Replies
PNegro
by New Contributor III
  • 3480 Views
  • 4 replies
  • 4 kudos

conda-env: error: unrecognized arguments: 'virtualenv': 'python_env.yaml'

I have registered an experiment as model in the model registry and when I start serving the model I get the following error:usage: conda-env [-h] {create,export,list,remove,update,config} ...conda-env: error: unrecognized arguments: 'virtualenv': 'py...

  • 3480 Views
  • 4 replies
  • 4 kudos
Latest Reply
PNegro
New Contributor III
  • 4 kudos

Hi Follks, Is there any new on this?.What should I do?ThanksBestPablo

  • 4 kudos
3 More Replies
TomasP
by New Contributor III
  • 1750 Views
  • 3 replies
  • 1 kudos

inability to consume model

Hello, I would like to ask where the problem may be.   I want to create a real time endpoint to real time model infering.  . i have created a simple cluster but i am not able to deploy the model i still get a yellow status - pending.  the whole pro...

image.png
  • 1750 Views
  • 3 replies
  • 1 kudos
Latest Reply
TomasP
New Contributor III
  • 1 kudos

Hi, already solved.... it was just wrong selected runtime

  • 1 kudos
2 More Replies
jonathan-dufaul
by Valued Contributor
  • 2133 Views
  • 3 replies
  • 1 kudos

How does mlflow determine if a pyfunc model uses SparkContext?

I've been getting this error pretty regularly while working with mlflow:"It appears that you are attempting to reference SparkContext from a broadcast variable, action, or transformation. SparkContext can only be used on the driver, not in code that ...

  • 2133 Views
  • 3 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

I checked the page and it looks like there is no integration with Datarobot and Datarobot doesn't contribute to mlflow. https://mlflow.org/ has all the integrations listed

  • 1 kudos
2 More Replies
ashrafkhan94
by New Contributor II
  • 1800 Views
  • 2 replies
  • 2 kudos

Resolved! Failure in mlflow.spark.load_model : Random Forrest pretrained model

model = mlflow.spark.load_model(model_uri=f"models:/{model_name}/{model_version}")Log:An error occurred while calling o2861.load.: org.apache.spark.SparkException: Job aborted due to stage failure: Task 4 in stage 4599.0 failed 4 times, most recent f...

  • 1800 Views
  • 2 replies
  • 2 kudos
Latest Reply
Noopur_Nigam
Databricks Employee
  • 2 kudos

Hi @Ashraf Khan​ Did you get a chance to look into Sean's response. Please let us know if you need more help on this.

  • 2 kudos
1 More Replies
Slalom_Tobias
by New Contributor III
  • 2954 Views
  • 2 replies
  • 0 kudos

Cannot serialize this model error when attempting MLFlow for SparkNLP

I'm attempting to use MLFlow to register models in Databricks and am following the recipe at...https://nlp.johnsnowlabs.com/docs/en/licensed_serving_spark_nlp_via_api_databricks_mlflowwhen i execute...mlflow.spark.log_model(pipeline, "lemmatizer", co...

  • 2954 Views
  • 2 replies
  • 0 kudos
Latest Reply
Vidula
Honored Contributor
  • 0 kudos

Hi @Tobias Cortese​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...

  • 0 kudos
1 More Replies
jdigiovanni
by New Contributor
  • 1448 Views
  • 3 replies
  • 0 kudos

EOFError trying to assign a model using a custom module

I'm in a Data Science Bootcamp, and the final case study includes data preprocessing (done), using a linear regression model on the data, then porting to SQL for visualization. The model build uses custom python code provided as part of the exercise....

  • 1448 Views
  • 3 replies
  • 0 kudos
Latest Reply
Vidula
Honored Contributor
  • 0 kudos

Hi @Joe DiGiovanni​ Just wanted to check in if you were able to resolve your issue or do you need more help? We'd love to hear from you.Thanks!

  • 0 kudos
2 More Replies
fsyshawn
by New Contributor II
  • 1108 Views
  • 2 replies
  • 0 kudos

How can we automate MLFLOW model serving in databricks?

Can we enable model serving either using cli or any other tools without go to the databricks model UI?

  • 1108 Views
  • 2 replies
  • 0 kudos
Latest Reply
Vidula
Honored Contributor
  • 0 kudos

Hi @Shawn Feng​ Does @Atanu Sarkar​  response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!

  • 0 kudos
1 More Replies
Somi
by New Contributor III
  • 1369 Views
  • 3 replies
  • 0 kudos

No saved model after stopping the cluster.

I have saved a keras model in some directories in dbfs to load and retrain that with more data, etc. The problem is that when cluster stops and restarts, seems those directories and model are no longer available there and it starts training a new mod...

  • 1369 Views
  • 3 replies
  • 0 kudos
Latest Reply
Somi
New Contributor III
  • 0 kudos

Hi @Vidula Khanna​ I figured it out by replacing OS library module with dbutils utilities. It looks like mre compatible with DBFS.

  • 0 kudos
2 More Replies
hulma
by New Contributor II
  • 3098 Views
  • 4 replies
  • 0 kudos

Model serving keep relaunching

Hello, I tried to serve my model realtime. Model process keeps relaunching.I am getting this error in the logs, TypeError: Descriptors cannot not be created directly. If this call came from a _pb2.py file, your generated code is out of date and must ...

  • 3098 Views
  • 4 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hey there @Hulma Abdul Rahman​ Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.Cheers!

  • 0 kudos
3 More Replies
ravi121
by New Contributor III
  • 2191 Views
  • 1 replies
  • 3 kudos

Can't edit the cluster created by mlflow model serving

I'm trying to deploy a ml model into production using mlflow. while in that process, I have registered the model to mlflow models. After that it created the cluster but then it was in pending state forever. when I checked the model events, I see a pr...

Screen Shot 2022-05-10 at 5.49.53 PM
  • 2191 Views
  • 1 replies
  • 3 kudos
Latest Reply
" src="" />
This widget could not be displayed.
This widget could not be displayed.
This widget could not be displayed.
  • 3 kudos

This widget could not be displayed.
I'm trying to deploy a ml model into production using mlflow. while in that process, I have registered the model to mlflow models. After that it created the cluster but then it was in pending state forever. when I checked the model events, I see a pr...

This widget could not be displayed.
  • 3 kudos
This widget could not be displayed.
vives
by New Contributor II
  • 3232 Views
  • 3 replies
  • 0 kudos

How to add signature to model logged through feature store?

It seems that the current method log_model from the FeatureStoreClient class lacks a way to pass in the model signature (as opposed as doing it through mlflow directly). Is there a workaround to append this information? Thanks!

  • 3232 Views
  • 3 replies
  • 0 kudos
Latest Reply
AmirLyall
Databricks Employee
  • 0 kudos

Hello!You can log a model with a signature by passing a signature object as an argument with your log_model call. Please see here.Here's an example of this in action in a databricks notebook.Hope that helps!-Amir

  • 0 kudos
2 More Replies
ravi121
by New Contributor III
  • 2701 Views
  • 1 replies
  • 1 kudos

Can't edit the cluster created by mlflow model serving

I'm trying to deploy a ml model into production using mlflow. while in that process, I have registered the model to mlflow models. After that it created the cluster but then it was in pending state forever. when I checked the model events, I see a p...

Screen Shot 2022-05-10 at 5.49.53 PM
  • 2701 Views
  • 1 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hey @ravi g​ Does @Kaniz Fatma​'s answer help? If it does, would you be happy to mark it as best? If it doesn't, please tell us so we can help you.Thanks!

  • 1 kudos
jhonw901227
by New Contributor II
  • 951 Views
  • 0 replies
  • 0 kudos

MLflow Model Serving on Azure Databricks

I know that in the documentation about model serving says.The cluster is maintained as long as serving is enabled, even if no active model version exists. To terminate the serving cluster, disable model serving for the registered model.The cluster is...

  • 951 Views
  • 0 replies
  • 0 kudos
Labels