cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

ptawil
by New Contributor III
  • 2988 Views
  • 2 replies
  • 4 kudos

Runtime error using MLFlow and Spark on databricks

Here is some model I created:class SomeModel(mlflow.pyfunc.PythonModel): def predict(self, context, input): # do fancy ML stuff # log results pandas_df = pd.DataFrame(...insert predictions here...) spark_df = spark...

  • 2988 Views
  • 2 replies
  • 4 kudos
Latest Reply
Nikhil3107
New Contributor III
  • 4 kudos

Any updates on this? I am running into the same issue@Patrick Tawil​ were you able to solve this problem? If so, do you mind sharing?

  • 4 kudos
1 More Replies
Idan
by New Contributor II
  • 2460 Views
  • 2 replies
  • 1 kudos

Using code_path in mlflow.pyfunc models on Databricks

We are using Databricks over AWS infra, registering models on mlflow. We write our in-project imports as from src.(module location) import (objects).Following examples online, I expected that when I use mlflow.pyfunc.log_model(...code_path=['PROJECT_...

  • 2460 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Idan Reshef​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...

  • 1 kudos
1 More Replies
Rajib_Kumar_De
by New Contributor II
  • 2339 Views
  • 3 replies
  • 3 kudos

Databricks AutoML (Forecasting) Python SDK for Model Serving

I am using Databricks AutoML ( Python SDK) to forecast bed occupancy. (Actually, Databricks used MLflow experiments for AutoML run). After training with different iterations, I registered the best model in the Databricks Model registry. Now I am tryi...

  • 2339 Views
  • 3 replies
  • 3 kudos
Latest Reply
Debayan
Databricks Employee
  • 3 kudos

Hi, It can be a bug if the python version is 3.9.5 and still the error is on compatibility. Could you please raise a support case to look into it further?

  • 3 kudos
2 More Replies
jonathan-dufaul
by Valued Contributor
  • 1006 Views
  • 0 replies
  • 1 kudos

is it possible to change the boilerplate code on a logged/saved pyfunc mlflow model?

When I log a pyfunc mlflow model, it generates a page that has this helpful code for using the model in production. Make Predictions Predict on a Spark DataFrame: import mlflow from pyspark.sql.functions import struct, col logged_model = 'runs:/1d......

  • 1006 Views
  • 0 replies
  • 1 kudos
fsyshawn
by New Contributor II
  • 1118 Views
  • 2 replies
  • 0 kudos

How can we automate MLFLOW model serving in databricks?

Can we enable model serving either using cli or any other tools without go to the databricks model UI?

  • 1118 Views
  • 2 replies
  • 0 kudos
Latest Reply
Vidula
Honored Contributor
  • 0 kudos

Hi @Shawn Feng​ Does @Atanu Sarkar​  response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!

  • 0 kudos
1 More Replies
matebreeze
by New Contributor
  • 1306 Views
  • 0 replies
  • 0 kudos

MLflow model serving: KeyError: 'python_function'

Hello, I am training a logistic regression on text with the help of an tf-idf vectorizer.This is done with MLflow and sklearn in databricks.The model itself is trained successfully in databricks and it is possible to accomplish predictions within the...

  • 1306 Views
  • 0 replies
  • 0 kudos
ravi121
by New Contributor III
  • 2208 Views
  • 1 replies
  • 3 kudos

Can't edit the cluster created by mlflow model serving

I'm trying to deploy a ml model into production using mlflow. while in that process, I have registered the model to mlflow models. After that it created the cluster but then it was in pending state forever. when I checked the model events, I see a pr...

Screen Shot 2022-05-10 at 5.49.53 PM
  • 2208 Views
  • 1 replies
  • 3 kudos
Latest Reply
" src="" />
This widget could not be displayed.
This widget could not be displayed.
This widget could not be displayed.
  • 3 kudos

This widget could not be displayed.
I'm trying to deploy a ml model into production using mlflow. while in that process, I have registered the model to mlflow models. After that it created the cluster but then it was in pending state forever. when I checked the model events, I see a pr...

This widget could not be displayed.
  • 3 kudos
This widget could not be displayed.
ravi121
by New Contributor III
  • 2740 Views
  • 1 replies
  • 1 kudos

Can't edit the cluster created by mlflow model serving

I'm trying to deploy a ml model into production using mlflow. while in that process, I have registered the model to mlflow models. After that it created the cluster but then it was in pending state forever. when I checked the model events, I see a p...

Screen Shot 2022-05-10 at 5.49.53 PM
  • 2740 Views
  • 1 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hey @ravi g​ Does @Kaniz Fatma​'s answer help? If it does, would you be happy to mark it as best? If it doesn't, please tell us so we can help you.Thanks!

  • 1 kudos
Vijeth
by New Contributor II
  • 3968 Views
  • 1 replies
  • 2 kudos

Resolved! How to deploy or create mlflow model as docker image with REST api endpoint within databricks?

Is it possible to create mlflow model as a docker image with REST api endpoint and use it for inferencing within databricks or hosting the image in azure container instances?

  • 3968 Views
  • 1 replies
  • 2 kudos
Latest Reply
BilalAslamDbrx
Databricks Employee
  • 2 kudos

@Vijeth Moudgalya​ , Hey there, we are definitely interested in making model serving easier and simpler on Databricks. There are some useful product features coming down the line - contact me at bilal dot aslam at databricks dot com if you are intere...

  • 2 kudos
Mohit_m
by Valued Contributor II
  • 2285 Views
  • 2 replies
  • 3 kudos

Resolved! How to enable and disable Model Serving using Rest API

ML flow model serving in Databricks docs details the options to enable and disable from the UIhttps://docs.databricks.com/applications/mlflow/model-serving.html

  • 2285 Views
  • 2 replies
  • 3 kudos
Latest Reply
Mohit_m
Valued Contributor II
  • 3 kudos

Please find below the REST APIs to enable and disable Model-ServingBelow are the examples in PythonYou need to use the token to interact with Rest APItoken = "dxxxxxx"instance = "https://<workspacexxx>.cloud.databricks.com"headers = {'Authorization':...

  • 3 kudos
1 More Replies
Labels