- 4776 Views
- 15 replies
- 2 kudos
Serving Endpoint Container Image Creation Fails
Hello, I trained a model using MLFlow, and saved the model as an artifact. I can load the model from a notebook and it works as expected (i.e. I can load the model using its URI).However, when I want to deploy it using Databricks endpoints, container...
- 4776 Views
- 15 replies
- 2 kudos
- 2 kudos
@ivan_calvo The problem still exists. Surely there has to be some other option than downgrading the ML cluster to DBR 14.3 LTS ML?
- 2 kudos
- 747 Views
- 2 replies
- 0 kudos
I want to develop an automated lead allocation system to prospect sales representatives.
I want to develop an automated lead allocation system to prospect sales representatives. Please suggest a suitable solution also any links if available.
- 747 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi jamesl,My use case is related to match the prospect sales agent for the customer entering retail store, when a customer enters a store based on the inputs provided and checking on if the customer is existing or new customer, I want to create a rea...
- 0 kudos
- 3010 Views
- 6 replies
- 4 kudos
- 3010 Views
- 6 replies
- 4 kudos
- 4 kudos
There could be multiple reasone why you're getting this error @avishkarborkar . If the course you're following requires Unity Catalog, first you need to check if you have a premium workspace. Next you need to make sure that your workspace is enabled ...
- 4 kudos
- 2175 Views
- 1 replies
- 0 kudos
Unable to Check Experiment Existence with path starting with /Workspace/ Directory in Databricks Pla
https://github.com/mlflow/mlflow/issues/11077 In Databricks, when attempting to set an experiment with an experiment_name specified as an absolute path from /Workspace/Shared/mlflow_experiment/<experiment_name>, the mlflow.set_experiment() function ...
- 2175 Views
- 1 replies
- 0 kudos
- 0 kudos
Before setting the experiment, use mlflow.get_experiment_by_name() to check if the experiment already exists. If it does, you can set the experiment without attempting to create it again.
- 0 kudos
- 547 Views
- 1 replies
- 0 kudos
What is the best to way to not deploy/run a workflow in production?
I am building and MLOps architecture.I do not want to deploy the training workflow to prod. My first approach was to selectively not deploy the workflow to prod, but this does not seem to be possible as in this thread:https://community.databricks.com...
- 547 Views
- 1 replies
- 0 kudos
- 0 kudos
Target Override Feature: You can use the target override feature to specify different configurations for different environments. However, this does not provide a direct way to exclude specific job resources.Environment-Specific Folders: Another app...
- 0 kudos
- 789 Views
- 1 replies
- 0 kudos
request for exam certification voucher
Hi , I've completed the course Machine Learning with Databricks ! Looking forward to learn more .
- 789 Views
- 1 replies
- 0 kudos
- 0 kudos
- 0 kudos
- 4862 Views
- 8 replies
- 0 kudos
One-hot encoding of strong cardinality features failing, causes downstream issues
Hi Databricks support,I'm training an ML model using mlflow on DBR 13.3 LTS ML, Spark 3.4.1 using databricks.automl_runtime 0.2.17 and databricks.automl 1.20.3, with shap 0.45.1. My training data has two float-type columns with three or fewer unique ...
- 4862 Views
- 8 replies
- 0 kudos
- 0 kudos
Hi @rtreves , sorry I was not able to investigate on the above. Not sure if you would be able to create a support ticket with Databricks as it may be an involved effort to review the code. I do have a suggestion, instead of relying on the automatic ...
- 0 kudos
- 1435 Views
- 1 replies
- 1 kudos
Resolved! Serving model with custom scoring script to a real-time endpoint
Hi, new to databricks here and wasn't able to find relevant info in the documentation.Is it not possible to serve a model with a custom scoring script to an online endpoint on databricks to customise inference ? the customisation is related to incomi...
- 1435 Views
- 1 replies
- 1 kudos
- 1 kudos
If I'm understanding, all you really want to do is have a pre/post - process function running with your model, is that correct? If so, you can do this by using the MLflow pyfunc model. Something like they do here:https://docs.databricks.com/en/machi...
- 1 kudos
- 1692 Views
- 0 replies
- 1 kudos
Table-Model Lineage for models without online Feature Lookups
Hi community,I am looking for the recommended way to achieve table-model lineage in Unity Catalog for models that don't use Feature Lookups but only offline features. When I use FeatureEngineeringClient.create_training_set with feature_lookups + mlfl...
- 1692 Views
- 0 replies
- 1 kudos
- 1333 Views
- 3 replies
- 0 kudos
Consequences of Not Using write_table with Feature Engineering Client and INSERT OVERWRITE
Hello Databricks Community,I am currently using the Feature Engineering client and have a few questions about best practices for writing to Feature Store Tables.I would like to know more about not using the write_table method directly from the featur...
- 1333 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @zed,How are you doing? As per my understanding, Consider using the write_table method from the Feature Engineering client to ensure that all Feature Store functionality is properly leveraged, such as cataloging, lineage tracking, and handling upd...
- 0 kudos
- 1443 Views
- 0 replies
- 0 kudos
Hyperopt (15.4 LTS ML) ignores autologger settings
I use ML Flow Experiment to store models once they leave very early tests and development. I switched lately to 15.4 LTS ML and was hit by unhinged Hyperopt behavior:it was creating Experiment logs ignoring i) autologger is off on the workspace level...
- 1443 Views
- 0 replies
- 0 kudos
- 1454 Views
- 0 replies
- 2 kudos
Bug: MLflow recipe
I'm not sure whether this is the right place, but we've encountered a bug in the datasets.py(https://github.com/mlflow/mlflow/blob/master/mlflow/recipes/steps/ingest/datasets.py.). Anyone using recipes beware of forementioned.def _convert_spark_df_to...
- 1454 Views
- 0 replies
- 2 kudos
- 712 Views
- 2 replies
- 0 kudos
AutoML forecast only supports integers as predicate target ?
Hi Community,I've playing around with AutoML and started with a simple forecast for Databricks samples.I used a copy of table samples.tpch.orders.To my supprise only integer types were available as Predicat Target. The field I was interested in forec...
- 712 Views
- 2 replies
- 0 kudos
- 0 kudos
@jkibiki wrote:Hi Community,I've playing around with AutoML and started with a simple forecast for Databricks samples.I used a copy of table samples.tpch.orders.To my supprise only integer types were available as Predicat Target. The field I was int...
- 0 kudos
- 1782 Views
- 3 replies
- 1 kudos
Not able to edit_mode UI_LOCKED to EDITABLE in bundle deployment for development mode
The edit_mode for Databricks jobs cannot be overridden using the bundle. Based on the jobs REST API docs, there is a functionality to set this parameter but in the bundle docs, it's not available. How can I use this in the bundle to override the para...
- 1782 Views
- 3 replies
- 1 kudos
- 1 kudos
The `edit_mode` property cannot be set by design. It is set to `UI_LOCKED` on bundle deployment to let viewers of the job in the UI know that any changes they make to the job instance are going to be clobbered the next time someone runs a bundle depl...
- 1 kudos
- 4835 Views
- 3 replies
- 2 kudos
How to proper use Databricks MLFlow Managed tracker/register with Databricks Workflow
Hey.I'm building a DevOps/MLOps pipeline to train/register simple scikit learn model.I created a simple Databricks Workflow to execute training and register task on specific .git branch. (Workflow is setup with Databricks Repo on specifc branch, with...
- 4835 Views
- 3 replies
- 2 kudos
- 2 kudos
I had same issue while trying to call notebook from workflow. I was able to do what you did. But it needs new experiment name for each run, so I had to do this:# Set the experimentexperiment_name = f"/Workspace/MLOps/{env}/experiment/{experiment}_{ti...
- 2 kudos
