error: not found: type XGBoostEstimator Spark & Scala
@amal15 - can you please include the below to the import statement and see if it works. ml.dmlc.xgboost4j.scala.spark.XGBoostEstimator
Hello,I'm trying to create and query a vector searc index like in this example : How to create and query a Vector Search index | Databricks on AWS on a databricks on azure. I have a cluster ina private network so i need to install the suggested lib ...
@ccataV - Databricks vector search is in public preview in selected regions as per the below documentation. However, since you look like a PVC user, you may need to reach out to Databricks support for accessibility. https://docs.databricks.com/en/gen...
Hi, For the model serving latency graph what is p50 and p99? I only have one model i am serving on this endpoing so im surprised to see two models being tracked
If im not mistaken this refers to 50% of responses and 99% responses and averages accordingly for the metrics? @s_park @Sujitha @Debayan
Hello experts,We would like to create a UDF function with input parameter a table_name. Please check the below simple example:CREATE OR REPLACE FUNCTION F_NAME(v_table_name STRING, v_w...
I am trying to deploy phi-3 model in databricks but getting below error while creating serving endpoint. Help us on this as soon as possible.
@enkefalos-commu - packaging library is already shipped with ML Runtime - https://docs.databricks.com/en/release-notes/runtime/14.3lts.html#installed-python-libraries. can you please remove it from your requirements.txt file and see if it resolves.
The dolly2.0 session involving RAGs was very informative!
Hi @VineethRavella, Thank you for attending DAIS 2023 and for sharing your experience on the community platform. We're glad to hear that you found the Dolly2.0 session involving RAGs informative! We wanted to let you know that the Databricks Communit...
Grean Learning and fun at the summit 2023 hosted by Databricks
Hi @Prabhaker, It's great to hear that you had such a positive experience at DAIS 2023! We're thrilled that you found the summit to be a great learning and networking opportunity. We wanted to let you know that the Databricks community team will be ...
I’m here to learn more about DataBricks MLOps. I’ve learnt so much about how to build and maintain a production-level ML models. I will apply this knowledge to build a scalable ML solutions for my company.
Hi @HangLePhuonf ! Thank you for sharing your experience and enthusiasm for Databricks MLOps! It's great to hear that you found the sessions valuable and are planning to apply your learnings to build scalable ML solutions for your company. I wanted t...
Hello,I'm interested in accessing several .mdb Access files stored in either Azure Data Lake Storage (ADLS) or the Databricks File System using Python. Could you provide guidance on how to accomplish this? It would be immensely helpful if you could a...
Hi @JamesBrown54, Let’s break down the steps for accessing .mdb Access files from both Azure data lake Storage (ADLS) and the Databricks File System using Python. Accessing .mdb Files in Azure data lake Storage (ADLS) Prerequisites: An Azure ...
We are facing this issue when accessing Features page. Our workspace is on AWS, ap-southeast-1.I think this is related to new feature for online tables and serverless. Is it because of online tables are not available yet in our region? If it not avai...
Hi @MinThuraZaw, I understand the issue you’re facing. Let’s break it down: Online Tables: Online Tables are a new feature in Databricks that allows you to create read-only copies of Delta tables optimized for online access. These tables are full...
I have a naive Bayes ML model that takes call attributes and predicts if the caller is going to abandon the call while they are on hold waiting to speak to an agent. The model lives in Databricks ML flow, I have it registered. What I need to do is ex...
Hi @chrisf_sts, Naive Bayes Model Overview: Naive Bayes is a probabilistic machine learning algorithm based on Bayes’ Theorem. It’s commonly used for classification tasks, such as spam filtering, document classification, and sentiment prediction....
Hello everyone,I have an Azure Databricks subscription with my company, and I want to use external LLMs in databricks, like claude-3 or gemini. I managed to create a serving endpoint for Anthropic and I am able to use claude 3.But I want to use a Gem...
Hi @Leo69, It seems you’re encountering an issue while trying to use the Gemini model through Databricks. Let’s troubleshoot this together! First, let’s review some important information about external models in Databricks Model Serving. External...
Hey,I'm composing an architecture within the usage of Model Serving Endpoints and one of the needs that we're aiming to resolve is Shadow Deployment.Currently, it seems that the traffic configurations available in model serving do not allow this type...
Hi @ryojikn, Shadow deployment is a valuable strategy for testing and validating changes in a production environment without impacting live traffic. Let’s explore some approaches and resources related to shadow deployments: Shadow Deployments: Wh...
#20 69.92 ERROR: Could not find a version that satisfies the requirement transformers==4.41.0.dev0 (from versions: 0.1, 2.0.0, 2.1.0, 2.1.1, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.6.0, 2.7.0, 2.8.0, 2.9.0, 2.9.1, 2.10.0, 2.11.0, 3....
I am looking for the more detailed resources comparing RAG to fine-tuning methods in AI models to processing text data with LLM in laymen notes. I have found one resource but looking for the more detailed view https://www.softwebsolutions.com/resour...
Hi @kapwilson, It seems you’re encountering an issue with using archive files in your Spark application submitted as a Jar task. Archive Files in Spark Applications: When submitting Spark applications, you can include additional files (such as Pyt...
