- 2246 Views
- 3 replies
- 4 kudos
Resolved! MLflow Model Serving on Azure Databricks General Availability
When is MLflow Model Serving on Azure Databricks expected to become General Available?
- 2246 Views
- 3 replies
- 4 kudos
- 4 kudos
Hello Mihai,We plan to GA, Model serving by end of this year as we are working on a lot of improvements.
- 4 kudos
- 13848 Views
- 6 replies
- 5 kudos
Resolved! ModuleNotFoundError: No module named 'mlflow' when running a notebook
I am running a notebook on the Coursera platform.my configuration file, Classroom-Setup, looks like this:%python spark.conf.set("com.databricks.training.module-name", "deep-learning") spark.conf.set("com.databricks.training.expected-dbr", "6.4") ...
- 13848 Views
- 6 replies
- 5 kudos
- 5 kudos
Hi @Maria Bruevich ,From the error description, it looks like the mlflow library is not present. You can use ML cluster as these type of cluster already have mlflow library. Please check the below document:https://docs.databricks.com/release-notes/r...
- 5 kudos
- 9184 Views
- 7 replies
- 7 kudos
Resolved! mlflow RESOURCE_ALREADY_EXISTS
I tried to log some run in my Databricks Workspace and I'm facing the following error: RESOURCE_ALREADY_EXISTS when I try to log any run.I could replicate the error with the following code:import mlflow import mlflow.sklearn from mlflow.tracking impo...
- 9184 Views
- 7 replies
- 7 kudos
- 7 kudos
Hi @Miguel Ángel Fernández it’s not recommended to “link” the Databricks and AML workspaces, as we are seeing more problems. You can refer to the instructions found below for using MLflow with AML. https://docs.microsoft.com/en-us/azure/machine-l...
- 7 kudos
- 2436 Views
- 2 replies
- 1 kudos
2021-08-Best-Practices-for-Your-Data-Architecture-v3-OG-1200x628
Thanks to everyone who joined the Best Practices for Your Data Architecture session on Getting Workloads to Production using CI/CD. You can access the on-demand session recording here, and the code in the Databricks Labs CI/CD Templates Repo. Posted ...
- 2436 Views
- 2 replies
- 1 kudos
- 1 kudos
Here's the embedded links list!Jobs scheduling and orchestrationBuilt-in job scheduling: https://docs.databricks.com/jobs.html#schedule-a-job Periodic scheduling of the jobsExecute notebook / jar / Python script / Spark-submitMultitask JobsExecute no...
- 1 kudos
- 5382 Views
- 0 replies
- 0 kudos
ColumnTransformer not fitted after sklearn Pipeline loaded from Mlflow
I am building a machine learning model using sklearn Pipeline which includes a ColumnTransformer as a preprocessor before the actual model. Below is the code how the pipeline is created.transformers = [] num_pipe = Pipeline(steps=[ ('imputer', Si...
- 5382 Views
- 0 replies
- 0 kudos
- 5294 Views
- 5 replies
- 3 kudos
Resolved! how to log the KerasClassifier model in a sklearn pipeline in mlflow?
I have a set of pre-processing stages in a sklearn `Pipeline` and an estimator which is a `KerasClassifier` (`from tensorflow.keras.wrappers.scikit_learn import KerasClassifier`).My overall goal is to tune and log the whole sklearn pipeline in `mlflo...
- 5294 Views
- 5 replies
- 3 kudos
- 1669 Views
- 2 replies
- 1 kudos
how to include a third-party Maven package in MLflow model serving job cluster in Azure Databricks
We try to use MLflow Model Serving, this service will enable realtime model serving behind a REST API interface; it will launch a single-node cluster that will host our model. The issue happens when the single-node cluster try to get the environment...
- 1669 Views
- 2 replies
- 1 kudos
- 1 kudos
Unfortunately we came across this same issue. We were trying to use MLFlow Serve to produce an API that could take text input and pass it through some NLP. In this instance we had installed a maven package on the cluster, so the experiment would run ...
- 1 kudos
- 1437 Views
- 2 replies
- 0 kudos
Resolved! What are the advantages of using Delta if I am using MLflow? How is Delta useful for DS/ML use cases?
I am already using MLflow. What benefit would Delta provide me since I am not really working on Data engineering workloads
- 1437 Views
- 2 replies
- 0 kudos
- 0 kudos
The most important aspect is your experiment can track the version of the data table. So during audits you will be able to trace back why a specific prediction was made.
- 0 kudos
- 1951 Views
- 1 replies
- 4 kudos
Resolved! Databricks Feature Store in MLFlow run CLI command
Hello!I am attempting to move some machine learning code from a databricks notebook into a mlflow git repository. I am utilizing the databricks feature store to load features that have been processed. Currently I cannot get the databricks library to ...
- 1951 Views
- 1 replies
- 4 kudos
- 4 kudos
Hm, what error do you get? I believe you won't be able to specify the feature store library as a dependency, as it's not externally published yet, but code that uses it should run on DB ML runtimes as it already exists there
- 4 kudos
- 1566 Views
- 1 replies
- 1 kudos
DNS_Analytics Notebook Problems
Hello everyone! First post on the forums, been stuck at this for awhile now and cannot seem to understand why this is happening. Basically, I have been using a seems to be premade Databricks notebook from Databricks themselves for a DNS Analytics exa...
- 1566 Views
- 1 replies
- 1 kudos
- 1 kudos
@NickGoodfella , What's the notebook you're looking at, this one? https://databricks.com/notebooks/dns-analytics.html Are you sure all the previous cells executed? this is suggesting there isn't a model at the path that's expected. You can take a lo...
- 1 kudos
- 2753 Views
- 5 replies
- 0 kudos
Error loading h2o model in mlflow
I'm getting the following error when I'm trying to load a h2o model using mlflow for prediction Error: Error Job with key $03017f00000132d4ffffffff$_990da74b0db027b33cc49d1d90934149 failed with an exception: java.lang.IllegalArgumentException:...
- 2753 Views
- 5 replies
- 0 kudos
- 0 kudos
I ran this in Databricks and it worked with no issues. I suggest you make sure your wget path is correct, because the one you posted downloads HTML, not the raw csv. That may cause the problem. %sh wget https://raw.githubusercontent.com/mlflow/mlflo...
- 0 kudos
- 1108 Views
- 0 replies
- 0 kudos
mlflow project train and validate - Control over the data used in the script?
Hi there, Trying to decide if I am going to get started with ml and really enjoyed it so far. When going through the documentation, there was a blocker moment for me, as I feel the documentation doesn't mention much about the dataset used to train t...
- 1108 Views
- 0 replies
- 0 kudos
- 1920 Views
- 1 replies
- 0 kudos
Resolved! Can I copy my MLflow experiments from one workspace to another?
I would like to move my saved experiments and artifacts to a different Databricks workspace from where I originally created them. Is this possible?
- 1920 Views
- 1 replies
- 0 kudos
- 0 kudos
It might be possible with a bit of code via mlflow client api ( there seems to be a way to run list_registered_models and extract info ) - but haven't tried it out. If the requirement is to share models between workspaces, one approach could be to h...
- 0 kudos
- 1468 Views
- 1 replies
- 0 kudos
Resolved! MLflow Model Serving latency expectations
What kind of latency should I expect when using the built in model serving capability in MLflow. Evaluating whether it would be a good fit for our use case
- 1468 Views
- 1 replies
- 0 kudos
- 0 kudos
What are your throughput requirements in addition to latency. Currently this is in private preview and databricks recommends this only for low throughput and non-critical applications. However, as it move towards GA, this would change. Please get in...
- 0 kudos
- 1681 Views
- 1 replies
- 0 kudos
- 1681 Views
- 1 replies
- 0 kudos
- 0 kudos
I think you cab find a solution on github page of ml flow - code examples here: https://github.com/mlflow/mlflow/issues/3592
- 0 kudos