cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

chrisf_sts
by New Contributor II
  • 314 Views
  • 1 replies
  • 0 kudos

Extract calculations naive bayes model

I have a naive Bayes ML model that takes call attributes and predicts if the caller is going to abandon the call while they are on hold waiting to speak to an agent. The model lives in Databricks ML flow, I have it registered. What I need to do is ex...

  • 314 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @chrisf_sts, Naive Bayes Model Overview: Naive Bayes is a probabilistic machine learning algorithm based on Bayes’ Theorem. It’s commonly used for classification tasks, such as spam filtering, document classification, and sentiment prediction....

  • 0 kudos
Leo69
by New Contributor
  • 121 Views
  • 1 replies
  • 0 kudos

"error_code":"INVALID_PARAMETER_VALUE","message":"INVALID_PARAMETER_VALUE: Failed to generate access

Hello everyone,I have an Azure Databricks subscription with my company, and I want to use external LLMs in databricks, like claude-3 or gemini. I managed to create a serving endpoint for Anthropic and I am able to use claude 3.But I want to use a Gem...

  • 121 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Leo69, It seems you’re encountering an issue while trying to use the Gemini model through Databricks. Let’s troubleshoot this together! First, let’s review some important information about external models in Databricks Model Serving. External...

  • 0 kudos
ryojikn
by New Contributor III
  • 149 Views
  • 1 replies
  • 0 kudos

Model Serving - Shadow Deployment - Azure

Hey,I'm composing an architecture within the usage of Model Serving Endpoints and one of the needs that we're aiming to resolve is Shadow Deployment.Currently, it seems that the traffic configurations available in model serving do not allow this type...

  • 149 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @ryojikn, Shadow deployment is a valuable strategy for testing and validating changes in a production environment without impacting live traffic. Let’s explore some approaches and resources related to shadow deployments: Shadow Deployments: Wh...

  • 0 kudos
enkefalos-commu
by New Contributor II
  • 360 Views
  • 4 replies
  • 0 kudos

Unable to create serving endpoint for the huggingface model phi-3-mini-128k-instruct

#20 69.92 ERROR: Could not find a version that satisfies the requirement transformers==4.41.0.dev0 (from versions: 0.1, 2.0.0, 2.1.0, 2.1.1, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.6.0, 2.7.0, 2.8.0, 2.9.0, 2.9.1, 2.10.0, 2.11.0, 3....

  • 360 Views
  • 4 replies
  • 0 kudos
Latest Reply
enkefalos-commu
New Contributor II
  • 0 kudos

@Kumaran I used latest one 2.12.1

  • 0 kudos
3 More Replies
kapwilson
by New Contributor II
  • 337 Views
  • 1 replies
  • 1 kudos

Resolved! How to fine-tune OpenAI’s large language models (LLMs)

I am looking for the more detailed resources comparing RAG to fine-tuning methods in AI models to processing text data with LLM in laymen notes. I have found one resource but looking for the more  detailed view https://www.softwebsolutions.com/resour...

  • 337 Views
  • 1 replies
  • 1 kudos
Latest Reply
Kaniz
Community Manager
  • 1 kudos

Hi @kapwilson, It seems you’re encountering an issue with using archive files in your Spark application submitted as a Jar task. Archive Files in Spark Applications: When submitting Spark applications, you can include additional files (such as Pyt...

  • 1 kudos
AndersenHuang
by New Contributor
  • 232 Views
  • 1 replies
  • 0 kudos

Spacy Retraining failure

Hello, I'm having problems trying to run my retraining notebook for a spacy model. The notebook creates a shell file with the following lines of code:    cmd = f''' awk '{{sub("source = ","source = /dbfs/FileStore/{dbfs_folder}/textcat/categories...

  • 232 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kumaran
Valued Contributor III
  • 0 kudos

Hi @AndersenHuang, Thank you for contacting Databricks community support. The error message you're encountering suggests that there's a permission issue when trying to copy the files. It's possible that the permissions for the directory /dbfs/FileSto...

  • 0 kudos
Edna
by New Contributor
  • 330 Views
  • 1 replies
  • 0 kudos

Model flavour using feature store model training log_model()

Hi I'm have succesfully registered my model using the feature engineering client with the following codes:with mlflow.start_run(): # Calculate the ratio of negative class samples to positive class samples ratio = (len(y_train) - y_train.sum()...

  • 330 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kumaran
Valued Contributor III
  • 0 kudos

Hello @Edna  Thank you for contacting Databricks community support. MLflow allows you to save models using different "flavors," which are essentially different ways of serializing and deserializing models. When you specify flavor=mlflow.sklearn, you'...

  • 0 kudos
tanjil
by New Contributor III
  • 475 Views
  • 3 replies
  • 0 kudos

Import mlflow Error

Hello, I am trying to replicate this motebook in my environment: mlflow-end-to-end-example - Databricks However, I am getting the following error when I run "import mlflow": "TypeError: bases must be types"How can I solve this issue? Thank you, Tanji...

  • 475 Views
  • 3 replies
  • 0 kudos
Latest Reply
Kumaran
Valued Contributor III
  • 0 kudos

Hello @tanjil    Thank you for contacting databricks community support. Could you check what version of protobuf you have? If you are using 10.4 ML cluster, the MLflow 1.x is not compatible with protobuf 4.x. The default version of protobuf in MLR 10...

  • 0 kudos
2 More Replies
ml-engineer
by New Contributor
  • 159 Views
  • 1 replies
  • 0 kudos

while registering model I am getting error: AssertionError:

while registering model I am getting error: AssertionError:I am getting error while running the code with workflow if I running code individually with notebook then its running fine.  below is the code :            fe = FeatureEngineeringClient()    ...

  • 159 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kumaran
Valued Contributor III
  • 0 kudos

Hi @ml-engineer Thank you for contacting Databricks community support. I think you are installing tensorflow version 2.14, could you update to 2.16 using the pip install --upgrade tensorflow and see how it works?

  • 0 kudos
Intuit-AIHome
by New Contributor
  • 287 Views
  • 1 replies
  • 0 kudos

GenAI democratizes AI field

Interesting to hear the latest tech trend at Data +AI summit. 

  • 287 Views
  • 1 replies
  • 0 kudos
Latest Reply
artsheiko
Valued Contributor III
  • 0 kudos

you can find the synthesis on a DAIS 2023 announcements here : https://medium.com/@youssefmrini/data-and-ai-summit-2023-announcements-6a4aade1d54c

  • 0 kudos
Data_Cowboy
by New Contributor III
  • 1188 Views
  • 3 replies
  • 0 kudos

Resolved! Problems with xgboost.spark model loading from MLflow.

When loading an xgboost model from mlflow following the provided instructions in Databricks hosted MLflow the input sizes I am showing on the job are over 1 TB. Is anyone else using an xgboost.spark model and noticing the same behavior? Below are som...

image.png image
  • 1188 Views
  • 3 replies
  • 0 kudos
Latest Reply
dbx-user7354
New Contributor III
  • 0 kudos

Thank you very much @Data_Cowboy !!! I had the same issue. I even had 14 TiB  Databricks should really fix this

  • 0 kudos
2 More Replies
Colombia
by New Contributor II
  • 400 Views
  • 2 replies
  • 1 kudos

Use OF API from package enerbitdso 0.1.8 PYPI

Hello! I have code to use an API supplied in the energitdso package (This is the repository https://pypi.org/project/enerbitdso/). I changed the code adapting it to AZURE DATABRICKS in python, but although there is a connection with the API, it does ...

  • 400 Views
  • 2 replies
  • 1 kudos
Latest Reply
Colombia
New Contributor II
  • 1 kudos

The owner of the package updated it to use the time out as a parameter of up to 20 seconds and updated a dependent package in DataBricks, with the above the problem was solved

  • 1 kudos
1 More Replies
re
by New Contributor II
  • 256 Views
  • 2 replies
  • 0 kudos

RBAC and VectorSearch

When implementing the managed VectorSearch, what is the preferred way to implement row based access control? I see that you can use the filter API during a query, so simple filters using a certain column may work, but what if all the security informa...

  • 256 Views
  • 2 replies
  • 0 kudos
Latest Reply
re
New Contributor II
  • 0 kudos

Thanks AI for summarizing my question. However, you did not actually answer it.

  • 0 kudos
1 More Replies
Lcsp
by New Contributor
  • 416 Views
  • 1 replies
  • 0 kudos

AssertionError Failed to create the catalog

getting this error when trying to setup the get-started-with-databricks-for-machine-learning  LAB . Unity catalog is enabled.  Validating the locally installed datasets: | listing local files...(0 seconds) | validation completed...(0 seconds total) C...

  • 416 Views
  • 1 replies
  • 0 kudos
Latest Reply
PL_db
New Contributor III
  • 0 kudos

 It looks like you don't have the CREATE CATALOG privilege on the metastore you're trying to create the catalog in: Privilege types by securable object in Unity Catalog 

  • 0 kudos
moh3th1
by New Contributor
  • 209 Views
  • 1 replies
  • 0 kudos

Optimal Cluster Configuration for Training on Billion-Row Datasets

Hello Databricks Community,I am currently facing a challenge in configuring a cluster for training machine learning models on a dataset consisting of approximately a billion rows and 40 features. Given the volume of data, I want to ensure that the cl...

  • 209 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @moh3th1 ,  Machine Selection: Memory (RAM): Having sufficient memory is essential for large datasets. Ensure that your machine type has enough RAM to accommodate your data.CPU: CPU power impacts data processing speed. Consider CPUs with multiple...

  • 0 kudos
Labels