- 8483 Views
- 15 replies
- 2 kudos
Serving Endpoint Container Image Creation Fails
Hello, I trained a model using MLFlow, and saved the model as an artifact. I can load the model from a notebook and it works as expected (i.e. I can load the model using its URI).However, when I want to deploy it using Databricks endpoints, container...
- 8483 Views
- 15 replies
- 2 kudos
- 2 kudos
@ivan_calvo The problem still exists. Surely there has to be some other option than downgrading the ML cluster to DBR 14.3 LTS ML?
- 2 kudos
- 1161 Views
- 2 replies
- 0 kudos
I want to develop an automated lead allocation system to prospect sales representatives.
I want to develop an automated lead allocation system to prospect sales representatives. Please suggest a suitable solution also any links if available.
- 1161 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi jamesl,My use case is related to match the prospect sales agent for the customer entering retail store, when a customer enters a store based on the inputs provided and checking on if the customer is existing or new customer, I want to create a rea...
- 0 kudos
- 3954 Views
- 6 replies
- 4 kudos
- 3954 Views
- 6 replies
- 4 kudos
- 4 kudos
There could be multiple reasone why you're getting this error @avishkarborkar . If the course you're following requires Unity Catalog, first you need to check if you have a premium workspace. Next you need to make sure that your workspace is enabled ...
- 4 kudos
- 2917 Views
- 1 replies
- 0 kudos
Unable to Check Experiment Existence with path starting with /Workspace/ Directory in Databricks Pla
https://github.com/mlflow/mlflow/issues/11077 In Databricks, when attempting to set an experiment with an experiment_name specified as an absolute path from /Workspace/Shared/mlflow_experiment/<experiment_name>, the mlflow.set_experiment() function ...
- 2917 Views
- 1 replies
- 0 kudos
- 0 kudos
Before setting the experiment, use mlflow.get_experiment_by_name() to check if the experiment already exists. If it does, you can set the experiment without attempting to create it again.
- 0 kudos
- 825 Views
- 1 replies
- 0 kudos
What is the best to way to not deploy/run a workflow in production?
I am building and MLOps architecture.I do not want to deploy the training workflow to prod. My first approach was to selectively not deploy the workflow to prod, but this does not seem to be possible as in this thread:https://community.databricks.com...
- 825 Views
- 1 replies
- 0 kudos
- 0 kudos
Target Override Feature: You can use the target override feature to specify different configurations for different environments. However, this does not provide a direct way to exclude specific job resources.Environment-Specific Folders: Another app...
- 0 kudos
- 1188 Views
- 1 replies
- 0 kudos
request for exam certification voucher
Hi , I've completed the course Machine Learning with Databricks ! Looking forward to learn more .
- 1188 Views
- 1 replies
- 0 kudos
- 0 kudos
- 0 kudos
- 8608 Views
- 8 replies
- 0 kudos
One-hot encoding of strong cardinality features failing, causes downstream issues
Hi Databricks support,I'm training an ML model using mlflow on DBR 13.3 LTS ML, Spark 3.4.1 using databricks.automl_runtime 0.2.17 and databricks.automl 1.20.3, with shap 0.45.1. My training data has two float-type columns with three or fewer unique ...
- 8608 Views
- 8 replies
- 0 kudos
- 0 kudos
Hi @rtreves , sorry I was not able to investigate on the above. Not sure if you would be able to create a support ticket with Databricks as it may be an involved effort to review the code. I do have a suggestion, instead of relying on the automatic ...
- 0 kudos
- 2049 Views
- 1 replies
- 1 kudos
Resolved! Serving model with custom scoring script to a real-time endpoint
Hi, new to databricks here and wasn't able to find relevant info in the documentation.Is it not possible to serve a model with a custom scoring script to an online endpoint on databricks to customise inference ? the customisation is related to incomi...
- 2049 Views
- 1 replies
- 1 kudos
- 1 kudos
If I'm understanding, all you really want to do is have a pre/post - process function running with your model, is that correct? If so, you can do this by using the MLflow pyfunc model. Something like they do here:https://docs.databricks.com/en/machi...
- 1 kudos
- 3064 Views
- 3 replies
- 0 kudos
Consequences of Not Using write_table with Feature Engineering Client and INSERT OVERWRITE
Hello Databricks Community,I am currently using the Feature Engineering client and have a few questions about best practices for writing to Feature Store Tables.I would like to know more about not using the write_table method directly from the featur...
- 3064 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @zed,How are you doing? As per my understanding, Consider using the write_table method from the Feature Engineering client to ensure that all Feature Store functionality is properly leveraged, such as cataloging, lineage tracking, and handling upd...
- 0 kudos
- 1168 Views
- 2 replies
- 0 kudos
AutoML forecast only supports integers as predicate target ?
Hi Community,I've playing around with AutoML and started with a simple forecast for Databricks samples.I used a copy of table samples.tpch.orders.To my supprise only integer types were available as Predicat Target. The field I was interested in forec...
- 1168 Views
- 2 replies
- 0 kudos
- 0 kudos
@jkibiki wrote:Hi Community,I've playing around with AutoML and started with a simple forecast for Databricks samples.I used a copy of table samples.tpch.orders.To my supprise only integer types were available as Predicat Target. The field I was int...
- 0 kudos
- 2663 Views
- 3 replies
- 1 kudos
Not able to edit_mode UI_LOCKED to EDITABLE in bundle deployment for development mode
The edit_mode for Databricks jobs cannot be overridden using the bundle. Based on the jobs REST API docs, there is a functionality to set this parameter but in the bundle docs, it's not available. How can I use this in the bundle to override the para...
- 2663 Views
- 3 replies
- 1 kudos
- 1 kudos
The `edit_mode` property cannot be set by design. It is set to `UI_LOCKED` on bundle deployment to let viewers of the job in the UI know that any changes they make to the job instance are going to be clobbered the next time someone runs a bundle depl...
- 1 kudos
- 6270 Views
- 3 replies
- 2 kudos
How to proper use Databricks MLFlow Managed tracker/register with Databricks Workflow
Hey.I'm building a DevOps/MLOps pipeline to train/register simple scikit learn model.I created a simple Databricks Workflow to execute training and register task on specific .git branch. (Workflow is setup with Databricks Repo on specifc branch, with...
- 6270 Views
- 3 replies
- 2 kudos
- 2 kudos
I had same issue while trying to call notebook from workflow. I was able to do what you did. But it needs new experiment name for each run, so I had to do this:# Set the experimentexperiment_name = f"/Workspace/MLOps/{env}/experiment/{experiment}_{ti...
- 2 kudos
- 3551 Views
- 1 replies
- 2 kudos
Run mlflow project from a Job.
Hey Guys, I'm trying to make automated process to run ML training sessions using mlflow and databricks jobs.While developing the model on my local machine using IDE, When finished I have a template notebook that get as parameters the mlflow project p...
- 3551 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi,Were you able to figure out this one? I have same issue trying to call training notebook from workflow. Each run needs a new experiment name which I can do but then it creates a new experiment ID/name for each workflow run. Where as when you run f...
- 2 kudos
- 1678 Views
- 1 replies
- 0 kudos
Serving Endpoint Deployment
Hello Community,I am seeking assistance with an issue related to serving a custom Hugging Face model (M2M100). I successfully registered the model in Unity Catalog using the MLflow Python libraries without any problems. However, when attempting to se...
- 1678 Views
- 1 replies
- 0 kudos
- 0 kudos
see https://community.databricks.com/t5/machine-learning/serving-endpoint-container-image-creation-fails/td-p/83458
- 0 kudos
- 2117 Views
- 2 replies
- 0 kudos
Azure databricks API and DLT databricks
how can i pass parameter from Azure data factory rest web API to delta live Databricks?I get this error: "Py4JJavaError: An error occurred while calling o382.getArgument.: com.databricks.dbutils_v1.InputWidgetNotDefined: No input widget named *** def...
- 2117 Views
- 2 replies
- 0 kudos
- 0 kudos
@girl_chan The error you are encountering usually occurs when a widget referenced in a Databricks notebook is not defined. In your case, the issue is likely related to how you pass parameters from Azure Data Factory (ADF) to Delta Live Tables (DLT) i...
- 0 kudos
