cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

John22
by New Contributor
  • 3411 Views
  • 1 replies
  • 0 kudos

EasyOcr Endpoint not accepting inputs

Hi all! I am trying to create an endpoint for Easy OCR. I was able to create the experiment using a wrapper class with the code below:  # import libraries import mlflow import mlflow.pyfunc import cloudpickle import cv2 import re import easyocr impo...

  • 3411 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kumaran
Databricks Employee
  • 0 kudos

Hi @John22, Thank you for posting your question on the Databricks community. First, are you able to infer the output within the notebook itself? Which cloud are you on AWS or Azure?

  • 0 kudos
117074
by New Contributor III
  • 1216 Views
  • 0 replies
  • 0 kudos

AutoML models not completing

Hello, Whilst using a cluster set-up running 14.3 LTS ML, 2-10 workers, worker and driver type of r5d.xlarge I am having issues creating a regression model on 700k rows and 80 factors (no high cardinality in any factor shown).The first phase of the e...

  • 1216 Views
  • 0 replies
  • 0 kudos
quintrix
by New Contributor II
  • 3476 Views
  • 1 replies
  • 0 kudos

DBRX - Serving endpoint failed - update timed out.

Hi,https://notebooks.databricks.com/demos/llm-rag-chatbot/index.htmlFollowing this tutorial I'm trying to serve an endpoint with DBRX model connected to my data in Vector Db.Without any problem I can log my model in Databricks with MLFlow and call th...

quintrix_0-1717395746345.png quintrix_1-1717395859283.png
  • 3476 Views
  • 1 replies
  • 0 kudos
MohsenJ
by Databricks Partner
  • 6315 Views
  • 1 replies
  • 0 kudos

mlops-stacks workflow testing vs staging

I'm a newbie to MLOps and abit confused about the use and the implementation of staging and testing environment in the mlops-stack template. as far as I understand the staging environment is where we run the integration test. But in the ci-cd pipelin...

  • 6315 Views
  • 1 replies
  • 0 kudos
Latest Reply
Dennisleon
New Contributor II
  • 0 kudos

@MohsenJOfficial Site wrote:I'm a newbie to MLOps and abit confused about the use and the implementation of staging and testing environment in the mlops-stack template. as far as I understand the staging environment is where we run the integration te...

  • 0 kudos
oteng
by Databricks Partner
  • 10749 Views
  • 5 replies
  • 5 kudos

DLT with unity catalog and ML

We are currently using DLT with unity catalog. DLT tables are created as materialized views in a schema inside a catalog. When we try to access these materialized view using a ML runtime (ex. 13.0 ML) cluster, it says, that we must use Single User se...

  • 10749 Views
  • 5 replies
  • 5 kudos
Latest Reply
pg5
New Contributor III
  • 5 kudos

No updates as far as I am aware.You could make the workflow copying the data smart though and try to only do incremental updates, seems like a lot of effort though.

  • 5 kudos
4 More Replies
racicot
by New Contributor
  • 1656 Views
  • 0 replies
  • 0 kudos

Conditional email notification based on if statement - dbutils

Is it possible to trigger an email notification based on a conditional statement in Python without exiting the process?Specifically, I have a robustness check in my prediction pipeline that performs simple imputation when encountering missing data. T...

  • 1656 Views
  • 0 replies
  • 0 kudos
thibault
by Contributor III
  • 8456 Views
  • 4 replies
  • 2 kudos

Best practice for model promotion so that models are not removed from previous stage

Hi,Using Model Registry to promote models is great. However, I am facing an issue, where multiple Databricks workspaces (SIT / UAT / Prod) use a model at various stages (Staging for SIT and UAT, Production for Prod workspace).We have a workflow runni...

  • 8456 Views
  • 4 replies
  • 2 kudos
Latest Reply
KarenGalvez
New Contributor III
  • 2 kudos

Thats what I need

  • 2 kudos
3 More Replies
victorNilsson
by New Contributor II
  • 2674 Views
  • 1 replies
  • 2 kudos

Promote registered UC models using CLI

Hi,I am currently transitioning some of our MLops workflows to use models registered in Unity Catalog (UC) instead of the "normal" model registry. I am trying to follow the instructions on https://docs.gcp.databricks.com/en/machine-learning/manage-mo...

  • 2674 Views
  • 1 replies
  • 2 kudos
Latest Reply
Dennisleon
New Contributor II
  • 2 kudos

@victorNilsson wrote:Hi,I am currently transitioning some of our MLops workflows to use models registered in Unity Catalog (UC) instead of the "normal" model registry. I am trying to follow the instructions on https://docs.gcp.databricks.com/en/machi...

  • 2 kudos
abhi-verma
by Databricks Partner
  • 9153 Views
  • 2 replies
  • 0 kudos

Lab for generative-ai-engineering-with-databricks.dbc doesn't work

It keeps on failing with this error:HTTPError: 503 Server Error: Service Unavailable for url: https://community.cloud.databricks.com/api/2.0/feature-store/feature-tables/search?max_results=200 Response from server: { 'error_code': 'TEMPORARILY_UNAVAI...

  • 9153 Views
  • 2 replies
  • 0 kudos
Latest Reply
vasyl_l
New Contributor II
  • 0 kudos

Any update with this issue?@abhi-verma  have you received some support?

  • 0 kudos
1 More Replies
rtreves
by Contributor
  • 1561 Views
  • 0 replies
  • 2 kudos

Customizing class imbalance handling in databricks.automl

Hi Databricks! I'd like to make a feature request for end users to be able to customize class imbalance behavior in `databricks.automl`, specifically `databricks.automl.classify`. This public documentation describes the default procedure, but my team...

  • 1561 Views
  • 0 replies
  • 2 kudos
Alex42
by New Contributor
  • 3949 Views
  • 1 replies
  • 0 kudos

Bug: MLflow connection fails after 2d

Hi there, After exactly 2d of training, the following error is raised after an API call to MLflow:  ValueError: Enum ErrorCode has no value defined for name '403' --------------------------------------------------------------------------- ValueError ...

  • 3949 Views
  • 1 replies
  • 0 kudos
Latest Reply
jessysantos
Databricks Employee
  • 0 kudos

Hello @Alex42 !The error message indicates that access is forbidden due to an expired access token. This occurs when a notebook or job runs for an extended period, exceeding the default 48-hour threshold set for security reasons. The Databricks acces...

  • 0 kudos
laurappp
by New Contributor II
  • 3831 Views
  • 2 replies
  • 0 kudos

Deploy ML

How deploy a model using community account version?

  • 3831 Views
  • 2 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

From your workspace page are you able to see the option to create Models?  

  • 0 kudos
1 More Replies
Lcsp
by New Contributor
  • 3963 Views
  • 4 replies
  • 0 kudos

AssertionError Failed to create the catalog

getting this error when trying to setup the get-started-with-databricks-for-machine-learning  LAB . Unity catalog is enabled.  Validating the locally installed datasets: | listing local files...(0 seconds) | validation completed...(0 seconds total) C...

  • 3963 Views
  • 4 replies
  • 0 kudos
Latest Reply
SalP
New Contributor II
  • 0 kudos

EDIT: I found the issue in my Databricks metastore was that it did not have a default storage location set. The academy setup scripts don't explicitly set MANAGED LOCATION and therefore without a default location it fails.I tried to establish a defau...

  • 0 kudos
3 More Replies
ppang
by New Contributor III
  • 2231 Views
  • 1 replies
  • 0 kudos

Does Databricks Container Services (DCS) support for GPU containers with Databricks Runtime 11.3 LTS and higher?

I have been trying to start a cluster using DCS with GPU containers (https://github.com/databricks/containers/tree/master/ubuntu/gpu), but was only successful with Databricks Runtime 10.4 LTS and lower. With Databricks Runtime 11.3 LTS and higher, I ...

  • 2231 Views
  • 1 replies
  • 0 kudos
Latest Reply
jessysantos
Databricks Employee
  • 0 kudos

Hello @ppang ! Since you posted your question, the repository you shared has received an update, which includes the following warning: "Using conda in DCS images is no longer supported starting Databricks Runtime 9.0. We highly recommend users to ext...

  • 0 kudos
RA_DATA
by New Contributor
  • 2291 Views
  • 1 replies
  • 0 kudos

Generative AI

I am working on generative AI. Does Databricks offer databases for storing vector embeddings, if yes, how efficient are they.  

  • 2291 Views
  • 1 replies
  • 0 kudos
Latest Reply
jessysantos
Databricks Employee
  • 0 kudos

Hello @RA_DATA !Yes, Databricks provides the Databricks Vector Search solution, which is a vector database optimized for storing and retrieving embeddings. With Vector Search, you can create a vector search index from a Delta table, which includes em...

  • 0 kudos
Labels