cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 31388 Views
  • 19 replies
  • 37 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 31388 Views
  • 19 replies
  • 37 kudos
Latest Reply
Poorva21
New Contributor III
  • 37 kudos

This is an exciting step forward from Databricks! Looking forward to diving into the curriculum and exploring what's next in the world of data + AI! Thanks for sharing @Sujitha 

  • 37 kudos
18 More Replies
SaiVihAI
by New Contributor
  • 4306 Views
  • 1 replies
  • 0 kudos

Multi Vector Index

Can we create multi vector indexes on multiple embedding columns in delta table as part of databricks vector search

  • 4306 Views
  • 1 replies
  • 0 kudos
Latest Reply
santhakumar11
New Contributor III
  • 0 kudos

Hi SaiVihAIDatabricks Vector Search currently does not support creating multi-vector indexes that are directly based on multiple embedding columns in a Delta table. Creating separate vector indexes for each embedding column is an option.Ref  How to c...

  • 0 kudos
SaiVihAI
by New Contributor
  • 1565 Views
  • 1 replies
  • 0 kudos

Vector Quantization

Does Databricks Vector Search support vector quantization?

  • 1565 Views
  • 1 replies
  • 0 kudos
Latest Reply
santhakumar11
New Contributor III
  • 0 kudos

Hi SaiVihAIIn my opinion, Databricks utilizes Mosaic Vector Search, which is largely aided by the Hierarchial Navigable Small World (HNSW) algorithm for neighbor search and hybrid keyword similarity search.Ref   Mosaic AI Vector Search | Databricks D...

  • 0 kudos
aliciachimeno
by New Contributor III
  • 6250 Views
  • 7 replies
  • 5 kudos

Genie Agent Integration in Databricks

I'm developing an Agent using the Cookbook template and would like to incorporate a Genie agent. I came across the Databricks GitHub repository and noticed they're actively working on it: GitHub - Genie Agent. However, it seems to be in the early sta...

  • 6250 Views
  • 7 replies
  • 5 kudos
Latest Reply
NathanSundarara
Valued Contributor
  • 5 kudos

I think Teams/Slack channel as a chat bot will be more exciting use case. When we demoed the Genie to our executives we are in Retail Industry Client and we have lots of stores one of the thing they said is this would be awesome if this can be in Tea...

  • 5 kudos
6 More Replies
sebascardonal
by New Contributor III
  • 9330 Views
  • 4 replies
  • 0 kudos

Resolved! LangGraph MemorySaver checkpointer usage with MLflow

Hi everyone.I am working on a graph that utilizes the MemorySaver class to incorporate short-term memory. This will enable me to maintain a multi-turn conversation with the user by storing the chat history.I am using the MLflow "models from code" fea...

  • 9330 Views
  • 4 replies
  • 0 kudos
Latest Reply
sebascardonal
New Contributor III
  • 0 kudos

Hi @moemedina. No, I didn't.I'm considering using ChatModel/ChatAgent class to wrap the graph and be able to move on. However, the MLflow documentation is still referring to ChatModel where Chat Agent is the latest recommendation:MLflow ChatModel Doc...

  • 0 kudos
3 More Replies
SaiVihAI
by New Contributor
  • 1307 Views
  • 1 replies
  • 0 kudos

Metadata filtering mechanism in Databricks Vector Search

Does Databricks vector search support pre-filtering or post-filtering or both in metadata filtering?

  • 1307 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @SaiVihAI, Yes, It uses in-query filtering. The algorithm takes a series of iterative steps to determine if the filtered set is small enough to execute brute-force search or if it proceeds with AN

  • 0 kudos
Mohamednazeer
by New Contributor III
  • 6235 Views
  • 2 replies
  • 2 kudos

Serving endpoint with external model (azure openai) is throwing "Public network access is disable "

Databricks serving endpoint is not working as expected throwing an exception as "Public network access is disable, Create private endpoints".We have create the azure openAI resource with public network access disabled, but also we have created the pr...

  • 6235 Views
  • 2 replies
  • 2 kudos
Latest Reply
Ismael-K
Databricks Employee
  • 2 kudos

Serving endpoints with external models will require creating Network Connectivity Configuration objects at the account level to connect to the Azure OpenAI resource. The feature is currently in private preview, please reach out to your Databricks acc...

  • 2 kudos
1 More Replies
VELU1122
by New Contributor II
  • 5365 Views
  • 1 replies
  • 0 kudos

Copying/cloning Vector index table

Regarding copying or cloning vector index tables, it appears that direct copying or cloning is not possible, as Databricks throws the message: "Securable with kind TABLE_ONLINE_VECTOR_INDEX_REPLICA does not support Lakehouse Federation."It seems that...

  • 5365 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ismael-K
Databricks Employee
  • 0 kudos

Direct cloning of a vector index table may not be possible. However, if Databricks generates the embeddings, you can enable "Sync computed embeddings" to save them to a Unity Catalog table. Alternatively, you can set the parameter sync_computed_embed...

  • 0 kudos
Paolo_Finardi
by New Contributor III
  • 2919 Views
  • 4 replies
  • 2 kudos

Building a Chatbot Assistant for Data Analysts Leveraging Unity Catalog

Hey everyone,I'm working on a project to enhance our data analysts' experience on the platform. In our company, we've done a great job with Unity Catalog, and we have comprehensive descriptions for all the tables and columns in our data lake.I'm inte...

  • 2919 Views
  • 4 replies
  • 2 kudos
Latest Reply
Paolo_Finardi
New Contributor III
  • 2 kudos

Hi MariuszK,I can confirm that the RAG architecture on Databricks works very well—we’ve taken it to production and are very satisfied with the results. As a first step, I'll try creating a Genie Room on the system table to see if it can help retrieve...

  • 2 kudos
3 More Replies
aero_g
by New Contributor
  • 1182 Views
  • 1 replies
  • 0 kudos

Issues with Generating Synthetic Data Using the Mosaic AI API - 403 Permission Denied Error

 Hi everyone,I’m currently working with the new Synthetic Data Generation API in Mosaic AI, and I’ve encountered an issue when trying to generate questions for a document. Specifically, I’m running into the following error:Failed to generate question...

  • 1182 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hi @aero_g, Looks like it is not supported on your region, but I will get more details internally.

  • 0 kudos
paalvibe
by New Contributor III
  • 1586 Views
  • 3 replies
  • 0 kudos

Should elaborate and complex LLM apps be deployed as MLFlow serving endpoints?

In a project we are building increasingly complex LLM-based Apps (RAG, multi-agent workflows, langgraph, unstructured ingestion etc), and we are having doubts if these apps should be deployed as MLFlow-based endpoints. I would like your feedback on i...

  • 1586 Views
  • 3 replies
  • 0 kudos
Latest Reply
paalvibe
New Contributor III
  • 0 kudos

Actually, maybe root folder was imprecise. The point is that it gets file system access. It becomes a regular Workspace user, with too much access. If, however, you want to give it specific accesses beyond that, you could give it access to specific v...

  • 0 kudos
2 More Replies
Nawneet
by New Contributor II
  • 944 Views
  • 1 replies
  • 0 kudos

Error running mlflow.evaluate()

Hi Team,I am following below article to evaluate my model.What is Mosaic AI Agent Evaluation? | Databricks on AWSExample for my model is below:input_example = pd.DataFrame({    "text": ["What is the stoppage duration for January month 2024?"],    "pa...

  • 944 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @Nawneet, Ensure that the input format for the agent evaluation matches the expected schema. Here is an example to structure your input data correctly: import mlflow import pandas as pd examples = { "request": [ {"messages": [{"ro...

  • 0 kudos
Kjetil
by Contributor
  • 4196 Views
  • 4 replies
  • 4 kudos

Model Serving and Streaming

Hi everyone,I have a question regarding the concurrency limitations of streaming responses from an LLM chain via Databricks Model Serving.When using a streaming response, the request remains open for the duration of the generation process. For exampl...

  • 4196 Views
  • 4 replies
  • 4 kudos
Latest Reply
LaurenFletcher
New Contributor II
  • 4 kudos

Wow, Thank you so much for your help.

  • 4 kudos
3 More Replies
kbmv
by Contributor
  • 2422 Views
  • 1 replies
  • 0 kudos

Resolved! Understanding compute requirements for Deploying Deepseek-R1-Distilled-Llama Models on databricks

Hi I came across the blog Deploying Deepseek-R1-Distilled-Llama Models on Databricks at https://www.databricks.com/blog/deepseek-r1-databricksI am new to using custom models that are not available as part of foundation models.According to the blog, I...

kbmv_0-1738850768911.png
  • 2422 Views
  • 1 replies
  • 0 kudos
Latest Reply
kbmv
Contributor
  • 0 kudos

Its Resolved https://community.databricks.com/t5/machine-learning/understanding-compute-requirements-for-deploying-deepseek-r1/m-p/109357#M3956

  • 0 kudos
dileepkumar_t
by New Contributor
  • 5521 Views
  • 1 replies
  • 0 kudos

Error - Interact with SQL database

 When I try to use Datbricks sql agent, I'm getting below error:DatabaseError: (databricks.sql.exc.ServerOperationError) [UNBOUND_SQL_PARAMETER] Found the unbound parameter: param_1. Please, fix `args` and provide a mapping of the parameter to a SQL ...

  • 5521 Views
  • 1 replies
  • 0 kudos
Latest Reply
kamal_ch
Databricks Employee
  • 0 kudos

Hi @dileepkumar_t The UNBOUND_SQL_PARAMETER error in Databricks SQL Agent occurs when a parameter marker in a SQL query is not associated with a value. This error is raised because the SQL query is expecting a parameter to be provided, but it has not...

  • 0 kudos
Mohanrajv27
by New Contributor
  • 4645 Views
  • 1 replies
  • 0 kudos

Cost Analysis for Databricks Compute

I am currently using the Databricks Vector Search on top of my databricks workspace and running the DBRX Model for querying off and retrieve the results out of it.I have noticed something, a category of compute occurred, which I haven't seen earlier....

  • 4645 Views
  • 1 replies
  • 0 kudos
Latest Reply
kamal_ch
Databricks Employee
  • 0 kudos

Hi @Mohanrajv27 The "Automated Serverless compute Pro" category in Databricks is designed to provide a serverless environment where compute resources are automatically managed and scaled by Databricks. Hope this answers your question!

  • 0 kudos