- 29929 Views
- 18 replies
- 33 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 29929 Views
- 18 replies
- 33 kudos
- 1115 Views
- 1 replies
- 0 kudos
Metadata filtering mechanism in Databricks Vector Search
Does Databricks vector search support pre-filtering or post-filtering or both in metadata filtering?
- 1115 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @SaiVihAI, Yes, It uses in-query filtering. The algorithm takes a series of iterative steps to determine if the filtered set is small enough to execute brute-force search or if it proceeds with AN
- 0 kudos
- 3704 Views
- 0 replies
- 0 kudos
Custom sentence transformer for indexing
Hi! i would like to use my own sentence transformer to create a vector index. It is not a problem using mlflow sentence-transformer flavour, it works fine with: mlflow.sentence_transformers.log_model( model, artifact_path="model", signatu...
- 3704 Views
- 0 replies
- 0 kudos
- 5266 Views
- 2 replies
- 2 kudos
Serving endpoint with external model (azure openai) is throwing "Public network access is disable "
Databricks serving endpoint is not working as expected throwing an exception as "Public network access is disable, Create private endpoints".We have create the azure openAI resource with public network access disabled, but also we have created the pr...
- 5266 Views
- 2 replies
- 2 kudos
- 2 kudos
Serving endpoints with external models will require creating Network Connectivity Configuration objects at the account level to connect to the Azure OpenAI resource. The feature is currently in private preview, please reach out to your Databricks acc...
- 2 kudos
- 4619 Views
- 1 replies
- 0 kudos
Copying/cloning Vector index table
Regarding copying or cloning vector index tables, it appears that direct copying or cloning is not possible, as Databricks throws the message: "Securable with kind TABLE_ONLINE_VECTOR_INDEX_REPLICA does not support Lakehouse Federation."It seems that...
- 4619 Views
- 1 replies
- 0 kudos
- 0 kudos
Direct cloning of a vector index table may not be possible. However, if Databricks generates the embeddings, you can enable "Sync computed embeddings" to save them to a Unity Catalog table. Alternatively, you can set the parameter sync_computed_embed...
- 0 kudos
- 2240 Views
- 4 replies
- 2 kudos
Building a Chatbot Assistant for Data Analysts Leveraging Unity Catalog
Hey everyone,I'm working on a project to enhance our data analysts' experience on the platform. In our company, we've done a great job with Unity Catalog, and we have comprehensive descriptions for all the tables and columns in our data lake.I'm inte...
- 2240 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi MariuszK,I can confirm that the RAG architecture on Databricks works very well—we’ve taken it to production and are very satisfied with the results. As a first step, I'll try creating a Genie Room on the system table to see if it can help retrieve...
- 2 kudos
- 965 Views
- 1 replies
- 0 kudos
Issues with Generating Synthetic Data Using the Mosaic AI API - 403 Permission Denied Error
Hi everyone,I’m currently working with the new Synthetic Data Generation API in Mosaic AI, and I’ve encountered an issue when trying to generate questions for a document. Specifically, I’m running into the following error:Failed to generate question...
- 965 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @aero_g, Looks like it is not supported on your region, but I will get more details internally.
- 0 kudos
- 1322 Views
- 3 replies
- 0 kudos
Should elaborate and complex LLM apps be deployed as MLFlow serving endpoints?
In a project we are building increasingly complex LLM-based Apps (RAG, multi-agent workflows, langgraph, unstructured ingestion etc), and we are having doubts if these apps should be deployed as MLFlow-based endpoints. I would like your feedback on i...
- 1322 Views
- 3 replies
- 0 kudos
- 0 kudos
Actually, maybe root folder was imprecise. The point is that it gets file system access. It becomes a regular Workspace user, with too much access. If, however, you want to give it specific accesses beyond that, you could give it access to specific v...
- 0 kudos
- 730 Views
- 1 replies
- 0 kudos
Error running mlflow.evaluate()
Hi Team,I am following below article to evaluate my model.What is Mosaic AI Agent Evaluation? | Databricks on AWSExample for my model is below:input_example = pd.DataFrame({ "text": ["What is the stoppage duration for January month 2024?"], "pa...
- 730 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Nawneet, Ensure that the input format for the agent evaluation matches the expected schema. Here is an example to structure your input data correctly: import mlflow import pandas as pd examples = { "request": [ {"messages": [{"ro...
- 0 kudos
- 5439 Views
- 3 replies
- 0 kudos
Unable to log MLFlow run for LangChain chain while using databricks-langchain library
Whenever I try to log my run it throws me the following error: MlflowException: Failed to save runnable sequence: {'0': 'RunnableParallel<query,context> -- Failed to save runnable sequence: {\'context\': "RunnableSequence -- Failed to save runnable s...
- 5439 Views
- 3 replies
- 0 kudos
- 3584 Views
- 4 replies
- 4 kudos
Model Serving and Streaming
Hi everyone,I have a question regarding the concurrency limitations of streaming responses from an LLM chain via Databricks Model Serving.When using a streaming response, the request remains open for the duration of the generation process. For exampl...
- 3584 Views
- 4 replies
- 4 kudos
- 4 kudos
Wow, Thank you so much for your help.
- 4 kudos
- 2220 Views
- 1 replies
- 0 kudos
Resolved! Understanding compute requirements for Deploying Deepseek-R1-Distilled-Llama Models on databricks
Hi I came across the blog Deploying Deepseek-R1-Distilled-Llama Models on Databricks at https://www.databricks.com/blog/deepseek-r1-databricksI am new to using custom models that are not available as part of foundation models.According to the blog, I...
- 2220 Views
- 1 replies
- 0 kudos
- 0 kudos
Its Resolved https://community.databricks.com/t5/machine-learning/understanding-compute-requirements-for-deploying-deepseek-r1/m-p/109357#M3956
- 0 kudos
- 3758 Views
- 0 replies
- 0 kudos
Issue in creating endpoint for quantized gguf model with llama-cpp-python
Hello, Databricks Community,I am experiencing an issue while trying to serve a quantized model in gguf format using Databricks serving with the llama-cpp-python library.The model is registered using MLflow and pyfunc on Unity. The model loads without...
- 3758 Views
- 0 replies
- 0 kudos
- 4386 Views
- 1 replies
- 0 kudos
Error - Interact with SQL database
When I try to use Datbricks sql agent, I'm getting below error:DatabaseError: (databricks.sql.exc.ServerOperationError) [UNBOUND_SQL_PARAMETER] Found the unbound parameter: param_1. Please, fix `args` and provide a mapping of the parameter to a SQL ...
- 4386 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @dileepkumar_t The UNBOUND_SQL_PARAMETER error in Databricks SQL Agent occurs when a parameter marker in a SQL query is not associated with a value. This error is raised because the SQL query is expecting a parameter to be provided, but it has not...
- 0 kudos
- 3976 Views
- 1 replies
- 0 kudos
Cost Analysis for Databricks Compute
I am currently using the Databricks Vector Search on top of my databricks workspace and running the DBRX Model for querying off and retrieve the results out of it.I have noticed something, a category of compute occurred, which I haven't seen earlier....
- 3976 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Mohanrajv27 The "Automated Serverless compute Pro" category in Databricks is designed to provide a serverless environment where compute resources are automatically managed and scaled by Databricks. Hope this answers your question!
- 0 kudos
- 1227 Views
- 2 replies
- 1 kudos
Tool Calls with Workspace Models
I recently followed the blog post on running deepseek llama distilled. I then served it via Serving Endpoints with provisioned throughput. In my use case I am using pydantic-ai to build out some simple agents for testing. It seems with this style ...
- 1227 Views
- 2 replies
- 1 kudos
- 1 kudos
Thanks @Alberto_Umana which one of these controls allows the conversation to continue past the first tool call? Is there documentation on all configurable fields? Also does this still allow override some of these at the client level? Ex. passing in...
- 1 kudos
Join Us as a Local Community Builder!
Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!
Sign Up Now-
agent
1 -
agents
2 -
AI
1 -
AI Agents
4 -
ai gateway
1 -
API Documentation
1 -
App
1 -
Application
1 -
automoation
1 -
Aws databricks
2 -
ChatDatabricks
1 -
claude
2 -
Cluster
1 -
Credentials
1 -
cursor
1 -
Databricks App
1 -
Databricks Course
1 -
Databricks Delta Table
1 -
Databricks Notebooks
1 -
Databricks SQL
1 -
Databricks-connect
1 -
delta sync
1 -
Delta Tables
1 -
Developer Experience
1 -
DLT Pipeline
1 -
Foundation Model
3 -
gemma
1 -
GenAI
7 -
GenAI agent
2 -
GenAI and LLMs
4 -
GenAI Generation AI
1 -
GenAIGeneration AI
20 -
Generation AI
2 -
Generative AI
4 -
Genie
14 -
Genie - Notebook Access
2 -
GenieAPI
3 -
healthcare
1 -
Index
1 -
inference table
1 -
Langchain
4 -
LangGraph
1 -
Llama
1 -
Llama 3.3
1 -
LLM
2 -
machine-learning
1 -
MlFlow
4 -
Mlflow registry
1 -
MLModels
1 -
Model Serving
1 -
mosic ai search
1 -
Multiagent
1 -
NPM error
1 -
Pandas udf
1 -
Playground
1 -
RAG
3 -
ro
1 -
Scheduling
1 -
Server
1 -
serving endpoint
1 -
streaming
1 -
Tasks
1 -
Vector
1 -
vector index
1 -
Vector Search
2 -
Vector search index
6
- « Previous
- Next »
| User | Count |
|---|---|
| 34 | |
| 19 | |
| 8 | |
| 7 | |
| 7 |