cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

ptawil
by New Contributor III
  • 1933 Views
  • 2 replies
  • 4 kudos

Runtime error using MLFlow and Spark on databricks

Here is some model I created:class SomeModel(mlflow.pyfunc.PythonModel): def predict(self, context, input): # do fancy ML stuff # log results pandas_df = pd.DataFrame(...insert predictions here...) spark_df = spark...

  • 1933 Views
  • 2 replies
  • 4 kudos
Latest Reply
Nikhil3107
New Contributor III
  • 4 kudos

Any updates on this? I am running into the same issue@Patrick Tawil​ were you able to solve this problem? If so, do you mind sharing?

  • 4 kudos
1 More Replies
Idan
by New Contributor II
  • 1246 Views
  • 2 replies
  • 1 kudos

Using code_path in mlflow.pyfunc models on Databricks

We are using Databricks over AWS infra, registering models on mlflow. We write our in-project imports as from src.(module location) import (objects).Following examples online, I expected that when I use mlflow.pyfunc.log_model(...code_path=['PROJECT_...

  • 1246 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Idan Reshef​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...

  • 1 kudos
1 More Replies
Rajib_Kumar_De
by New Contributor II
  • 1320 Views
  • 4 replies
  • 3 kudos

Databricks AutoML (Forecasting) Python SDK for Model Serving

I am using Databricks AutoML ( Python SDK) to forecast bed occupancy. (Actually, Databricks used MLflow experiments for AutoML run). After training with different iterations, I registered the best model in the Databricks Model registry. Now I am tryi...

  • 1320 Views
  • 4 replies
  • 3 kudos
Latest Reply
Kaniz
Community Manager
  • 3 kudos

Hi @Rajib Kumar De​(Customer)​ , We haven’t heard from you since the last response from @Debayan Mukherjee​ ​ ​, and I was checking back to see if his suggestions helped you. Or else, If you have any solution, please do share that with the community ...

  • 3 kudos
3 More Replies
jonathan-dufaul
by Valued Contributor
  • 634 Views
  • 0 replies
  • 1 kudos

is it possible to change the boilerplate code on a logged/saved pyfunc mlflow model?

When I log a pyfunc mlflow model, it generates a page that has this helpful code for using the model in production. Make Predictions Predict on a Spark DataFrame: import mlflow from pyspark.sql.functions import struct, col logged_model = 'runs:/1d......

  • 634 Views
  • 0 replies
  • 1 kudos
fsyshawn
by New Contributor II
  • 575 Views
  • 2 replies
  • 0 kudos

How can we automate MLFLOW model serving in databricks?

Can we enable model serving either using cli or any other tools without go to the databricks model UI?

  • 575 Views
  • 2 replies
  • 0 kudos
Latest Reply
Vidula
Honored Contributor
  • 0 kudos

Hi @Shawn Feng​ Does @Atanu Sarkar​  response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!

  • 0 kudos
1 More Replies
matebreeze
by New Contributor
  • 865 Views
  • 0 replies
  • 0 kudos

MLflow model serving: KeyError: 'python_function'

Hello, I am training a logistic regression on text with the help of an tf-idf vectorizer.This is done with MLflow and sklearn in databricks.The model itself is trained successfully in databricks and it is possible to accomplish predictions within the...

  • 865 Views
  • 0 replies
  • 0 kudos
ravi121
by New Contributor III
  • 1200 Views
  • 3 replies
  • 3 kudos

Can't edit the cluster created by mlflow model serving

I'm trying to deploy a ml model into production using mlflow. while in that process, I have registered the model to mlflow models. After that it created the cluster but then it was in pending state forever. when I checked the model events, I see a pr...

Screen Shot 2022-05-10 at 5.49.53 PM
  • 1200 Views
  • 3 replies
  • 3 kudos
Latest Reply
Kaniz
Community Manager
  • 3 kudos

Hi @ravi g​, I found this S.0 thread with an explanation. Please let us know if this helps.

  • 3 kudos
2 More Replies
ravi121
by New Contributor III
  • 1552 Views
  • 2 replies
  • 3 kudos

Resolved! Can't edit the cluster created by mlflow model serving

I'm trying to deploy a ml model into production using mlflow. while in that process, I have registered the model to mlflow models. After that it created the cluster but then it was in pending state forever. when I checked the model events, I see a p...

Screen Shot 2022-05-10 at 5.49.53 PM
  • 1552 Views
  • 2 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hey @ravi g​ Does @Kaniz Fatma​'s answer help? If it does, would you be happy to mark it as best? If it doesn't, please tell us so we can help you.Thanks!

  • 3 kudos
1 More Replies
Vijeth
by New Contributor II
  • 2859 Views
  • 2 replies
  • 2 kudos

Resolved! How to deploy or create mlflow model as docker image with REST api endpoint within databricks?

Is it possible to create mlflow model as a docker image with REST api endpoint and use it for inferencing within databricks or hosting the image in azure container instances?

  • 2859 Views
  • 2 replies
  • 2 kudos
Latest Reply
Kaniz
Community Manager
  • 2 kudos

Hi @Vijeth Moudgalya​ ​ , Just a friendly follow-up. Did you follow @Bilal Aslam​ 's suggestion? Please let us know.

  • 2 kudos
1 More Replies
Mohit_m
by Valued Contributor II
  • 1054 Views
  • 2 replies
  • 3 kudos

Resolved! How to enable and disable Model Serving using Rest API

ML flow model serving in Databricks docs details the options to enable and disable from the UIhttps://docs.databricks.com/applications/mlflow/model-serving.html

  • 1054 Views
  • 2 replies
  • 3 kudos
Latest Reply
Mohit_m
Valued Contributor II
  • 3 kudos

Please find below the REST APIs to enable and disable Model-ServingBelow are the examples in PythonYou need to use the token to interact with Rest APItoken = "dxxxxxx"instance = "https://<workspacexxx>.cloud.databricks.com"headers = {'Authorization':...

  • 3 kudos
1 More Replies
Labels