cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

SOlivero
by New Contributor III
  • 1065 Views
  • 0 replies
  • 0 kudos

Register Model mounted in S3

Hello!I'm having an issue registering a model saved in a mounted S3 bucket using mlflow.Let me give a little bit more context:1. First I mounted my S3 with all the corresponding IAM permissions:s3_bucket_name = f"s3a://{s3_bucket}"dbutils.fs.mount(so...

  • 1065 Views
  • 0 replies
  • 0 kudos
Giuseppina
by New Contributor III
  • 3460 Views
  • 3 replies
  • 0 kudos

Resolved! Llm

Are LLMs really ready for production deployment?

  • 3460 Views
  • 3 replies
  • 0 kudos
Latest Reply
ryojikn
New Contributor III
  • 0 kudos

You should be careful while putting them to production without guardrails, perhaps using Mosaic AI gateway announced today that would aggregate these functionalities, it should be something to start. These are not the only things you should worry abo...

  • 0 kudos
2 More Replies
Anonymous
by Not applicable
  • 4470 Views
  • 4 replies
  • 4 kudos

Generate and export dbt documentation from the Workflow dbt task to S3

I'm testing the Databricks Jobs feature with a dbt task and wanted to know if you had any advice for me for managing dbt documentation.I can use "dbt run" commands to run my models then "dbt docs generate" to generate the documentation. But is it pos...

  • 4470 Views
  • 4 replies
  • 4 kudos
Latest Reply
136039
New Contributor II
  • 4 kudos

How can I access these target files from the task itself ? I am trying to use dbt's state modifiers for detecting models that changed and only running models when the source freshness changed. Is there an easy way to store and use these state files i...

  • 4 kudos
3 More Replies
UnniKAnat
by New Contributor
  • 1467 Views
  • 1 replies
  • 1 kudos

ML Model

What's the best option to store your trained ML models

  • 1467 Views
  • 1 replies
  • 1 kudos
Latest Reply
mheffernan
New Contributor II
  • 1 kudos

Depending on how many you have, different solutions may be appropriate - and conveniently, you can use MLflow as a front end for most of these if you're working in Python. If you're working on personal projects, a local MLflow instance might be the r...

  • 1 kudos
JC3
by New Contributor II
  • 1090 Views
  • 2 replies
  • 0 kudos

Can view Model Registry using a Service Principal, but cannot load the model for inference.

I have a Service Principal (for M2M auth) with read access to a Databricks Model Registry. I can successfully search the registry (via the `WorkspaceClient`) and find the model that I want to load using (Python) APIs, but I cannot load the model for ...

  • 1090 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kumaran
Databricks Employee
  • 0 kudos

Hello @JC3, Thank you for posting your question in the Databricks community. Is it possible to share with us the minimum reproducible code?

  • 0 kudos
1 More Replies
leolmz
by New Contributor II
  • 1089 Views
  • 2 replies
  • 0 kudos

Download model artifact with HTTP

Hi, I want to pass a link for Kserve to download a model registered in Mlflow, which uses an HTTP request method to do that (it can be downloaded directly from GitHub or HuggingFace). Will setting up an artifact store in S3 or other public storage se...

  • 1089 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kumaran
Databricks Employee
  • 0 kudos

Hi @leolmz, You can refer to the doc for downloading the model artifacts

  • 0 kudos
1 More Replies
John22
by New Contributor
  • 1745 Views
  • 1 replies
  • 0 kudos

EasyOcr Endpoint not accepting inputs

Hi all! I am trying to create an endpoint for Easy OCR. I was able to create the experiment using a wrapper class with the code below:  # import libraries import mlflow import mlflow.pyfunc import cloudpickle import cv2 import re import easyocr impo...

  • 1745 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kumaran
Databricks Employee
  • 0 kudos

Hi @John22, Thank you for posting your question on the Databricks community. First, are you able to infer the output within the notebook itself? Which cloud are you on AWS or Azure?

  • 0 kudos
117074
by New Contributor III
  • 716 Views
  • 0 replies
  • 0 kudos

AutoML models not completing

Hello, Whilst using a cluster set-up running 14.3 LTS ML, 2-10 workers, worker and driver type of r5d.xlarge I am having issues creating a regression model on 700k rows and 80 factors (no high cardinality in any factor shown).The first phase of the e...

  • 716 Views
  • 0 replies
  • 0 kudos
quintrix
by New Contributor II
  • 1653 Views
  • 1 replies
  • 0 kudos

DBRX - Serving endpoint failed - update timed out.

Hi,https://notebooks.databricks.com/demos/llm-rag-chatbot/index.htmlFollowing this tutorial I'm trying to serve an endpoint with DBRX model connected to my data in Vector Db.Without any problem I can log my model in Databricks with MLFlow and call th...

quintrix_0-1717395746345.png quintrix_1-1717395859283.png
  • 1653 Views
  • 1 replies
  • 0 kudos
MohsenJ
by Contributor
  • 840 Views
  • 1 replies
  • 0 kudos

mlops-stacks workflow testing vs staging

I'm a newbie to MLOps and abit confused about the use and the implementation of staging and testing environment in the mlops-stack template. as far as I understand the staging environment is where we run the integration test. But in the ci-cd pipelin...

  • 840 Views
  • 1 replies
  • 0 kudos
Latest Reply
Dennisleon
New Contributor II
  • 0 kudos

@MohsenJOfficial Site wrote:I'm a newbie to MLOps and abit confused about the use and the implementation of staging and testing environment in the mlops-stack template. as far as I understand the staging environment is where we run the integration te...

  • 0 kudos
oteng
by New Contributor III
  • 8861 Views
  • 5 replies
  • 5 kudos

DLT with unity catalog and ML

We are currently using DLT with unity catalog. DLT tables are created as materialized views in a schema inside a catalog. When we try to access these materialized view using a ML runtime (ex. 13.0 ML) cluster, it says, that we must use Single User se...

  • 8861 Views
  • 5 replies
  • 5 kudos
Latest Reply
pg5
New Contributor III
  • 5 kudos

No updates as far as I am aware.You could make the workflow copying the data smart though and try to only do incremental updates, seems like a lot of effort though.

  • 5 kudos
4 More Replies
racicot
by New Contributor
  • 1097 Views
  • 0 replies
  • 0 kudos

Conditional email notification based on if statement - dbutils

Is it possible to trigger an email notification based on a conditional statement in Python without exiting the process?Specifically, I have a robustness check in my prediction pipeline that performs simple imputation when encountering missing data. T...

  • 1097 Views
  • 0 replies
  • 0 kudos
thibault
by Contributor II
  • 4315 Views
  • 4 replies
  • 2 kudos

Best practice for model promotion so that models are not removed from previous stage

Hi,Using Model Registry to promote models is great. However, I am facing an issue, where multiple Databricks workspaces (SIT / UAT / Prod) use a model at various stages (Staging for SIT and UAT, Production for Prod workspace).We have a workflow runni...

  • 4315 Views
  • 4 replies
  • 2 kudos
Latest Reply
KarenGalvez
New Contributor III
  • 2 kudos

Thats what I need

  • 2 kudos
3 More Replies
victorNilsson
by New Contributor II
  • 1356 Views
  • 1 replies
  • 2 kudos

Promote registered UC models using CLI

Hi,I am currently transitioning some of our MLops workflows to use models registered in Unity Catalog (UC) instead of the "normal" model registry. I am trying to follow the instructions on https://docs.gcp.databricks.com/en/machine-learning/manage-mo...

  • 1356 Views
  • 1 replies
  • 2 kudos
Latest Reply
Dennisleon
New Contributor II
  • 2 kudos

@victorNilsson wrote:Hi,I am currently transitioning some of our MLops workflows to use models registered in Unity Catalog (UC) instead of the "normal" model registry. I am trying to follow the instructions on https://docs.gcp.databricks.com/en/machi...

  • 2 kudos
abhi-verma
by New Contributor II
  • 8228 Views
  • 2 replies
  • 0 kudos

Lab for generative-ai-engineering-with-databricks.dbc doesn't work

It keeps on failing with this error:HTTPError: 503 Server Error: Service Unavailable for url: https://community.cloud.databricks.com/api/2.0/feature-store/feature-tables/search?max_results=200 Response from server: { 'error_code': 'TEMPORARILY_UNAVAI...

  • 8228 Views
  • 2 replies
  • 0 kudos
Latest Reply
vasyl_l
New Contributor II
  • 0 kudos

Any update with this issue?@abhi-verma  have you received some support?

  • 0 kudos
1 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels