cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

enkefalos-commu
by New Contributor III
  • 504 Views
  • 3 replies
  • 1 kudos

Unable to deploy phi-3 model due to packaging library

I am trying to deploy phi-3 model in databricks but getting below error while creating serving endpoint. Help us on this as soon as possible.

  • 504 Views
  • 3 replies
  • 1 kudos
Latest Reply
Erwanlc
Visitor
  • 1 kudos

Hello, I'm facing the same issue. No matter what I am trying, I end up with dependencies issues...

  • 1 kudos
2 More Replies
Miki
by New Contributor II
  • 248 Views
  • 2 replies
  • 0 kudos

Logging signature slows down inference to a crawl

I am having a similar issue thislog signature and input data for Spark LinearRegression using mlflow v2.13.0 and using mlflow.pyfunc.log_model to log my model. Starting a new post here since there doesn't seem to be any follow up from the community o...

Machine Learning
mlflow
signature
  • 248 Views
  • 2 replies
  • 0 kudos
Latest Reply
MohsenJ
Contributor
  • 0 kudos

@Miki can you please share you code for logging the signature with array types

  • 0 kudos
1 More Replies
bamvallar
by New Contributor
  • 634 Views
  • 0 replies
  • 0 kudos

computer vision

how does data bricks handle. computer vision related use cases? (eg defects detection for a manufacturing industry) is there a reference architecture 

  • 634 Views
  • 0 replies
  • 0 kudos
rahuja
by New Contributor III
  • 295 Views
  • 5 replies
  • 0 kudos

Sharing Output between different tasks for MLOps pipeline as a Databricks Jobs

Hello EveryoneWe are trying to create an ML pipeline on Databricks using the famous Databricks workflows. Currently our pipeline includes having 3 major components: Data Ingestion, Model Training and Model Testing. My question is whether it is possib...

  • 295 Views
  • 5 replies
  • 0 kudos
Latest Reply
rahuja
New Contributor III
  • 0 kudos

@Kaniz @Hkesharwani  any updates?

  • 0 kudos
4 More Replies
SOlivero
by New Contributor III
  • 32 Views
  • 0 replies
  • 0 kudos

Register Model mounted in S3

Hello!I'm having an issue registering a model saved in a mounted S3 bucket using mlflow.Let me give a little bit more context:1. First I mounted my S3 with all the corresponding IAM permissions:s3_bucket_name = f"s3a://{s3_bucket}"dbutils.fs.mount(so...

  • 32 Views
  • 0 replies
  • 0 kudos
Giuseppina
by New Contributor III
  • 1169 Views
  • 3 replies
  • 0 kudos

Resolved! Llm

Are LLMs really ready for production deployment?

  • 1169 Views
  • 3 replies
  • 0 kudos
Latest Reply
ryojikn
New Contributor III
  • 0 kudos

You should be careful while putting them to production without guardrails, perhaps using Mosaic AI gateway announced today that would aggregate these functionalities, it should be something to start. These are not the only things you should worry abo...

  • 0 kudos
2 More Replies
Anonymous
by Not applicable
  • 2420 Views
  • 5 replies
  • 4 kudos

Generate and export dbt documentation from the Workflow dbt task to S3

I'm testing the Databricks Jobs feature with a dbt task and wanted to know if you had any advice for me for managing dbt documentation.I can use "dbt run" commands to run my models then "dbt docs generate" to generate the documentation. But is it pos...

  • 2420 Views
  • 5 replies
  • 4 kudos
Latest Reply
136039
New Contributor II
  • 4 kudos

How can I access these target files from the task itself ? I am trying to use dbt's state modifiers for detecting models that changed and only running models when the source freshness changed. Is there an easy way to store and use these state files i...

  • 4 kudos
4 More Replies
GGG_P
by New Contributor III
  • 1911 Views
  • 2 replies
  • 2 kudos

How to proper use Databricks MLFlow Managed tracker/register with Databricks Workflow

Hey.I'm building a DevOps/MLOps pipeline to train/register simple scikit learn model.I created a simple Databricks Workflow to execute training and register task on specific .git branch. (Workflow is setup with Databricks Repo on specifc branch, with...

  • 1911 Views
  • 2 replies
  • 2 kudos
Latest Reply
BernardoC
New Contributor
  • 2 kudos

Nice contribution!

  • 2 kudos
1 More Replies
UnniKAnat
by New Contributor
  • 120 Views
  • 1 replies
  • 1 kudos

ML Model

What's the best option to store your trained ML models

  • 120 Views
  • 1 replies
  • 1 kudos
Latest Reply
mheffernan
New Contributor
  • 1 kudos

Depending on how many you have, different solutions may be appropriate - and conveniently, you can use MLflow as a front end for most of these if you're working in Python. If you're working on personal projects, a local MLflow instance might be the r...

  • 1 kudos
JC3
by New Contributor II
  • 368 Views
  • 2 replies
  • 0 kudos

Can view Model Registry using a Service Principal, but cannot load the model for inference.

I have a Service Principal (for M2M auth) with read access to a Databricks Model Registry. I can successfully search the registry (via the `WorkspaceClient`) and find the model that I want to load using (Python) APIs, but I cannot load the model for ...

  • 368 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kumaran
Valued Contributor III
  • 0 kudos

Hello @JC3, Thank you for posting your question in the Databricks community. Is it possible to share with us the minimum reproducible code?

  • 0 kudos
1 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels