- 19464 Views
- 13 replies
- 22 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 19464 Views
- 13 replies
- 22 kudos
- 9 Views
- 0 replies
- 1 kudos
AI_QUERY fails with o1-mini
As of sometime between March 7th and March 12, the AI_QUERY function has become very temperamental with Azure OpenAI models.Asking a basic question of our Mosaic AI o1-mini serving endpoint using AI_QUERY causes an error sometimes but not every time:...
- 9 Views
- 0 replies
- 1 kudos
- 1071 Views
- 2 replies
- 2 kudos
Serving endpoint with external model (azure openai) is throwing "Public network access is disable "
Databricks serving endpoint is not working as expected throwing an exception as "Public network access is disable, Create private endpoints".We have create the azure openAI resource with public network access disabled, but also we have created the pr...
- 1071 Views
- 2 replies
- 2 kudos
- 2 kudos
Serving endpoints with external models will require creating Network Connectivity Configuration objects at the account level to connect to the Azure OpenAI resource. The feature is currently in private preview, please reach out to your Databricks acc...
- 2 kudos
- 1079 Views
- 1 replies
- 0 kudos
Copying/cloning Vector index table
Regarding copying or cloning vector index tables, it appears that direct copying or cloning is not possible, as Databricks throws the message: "Securable with kind TABLE_ONLINE_VECTOR_INDEX_REPLICA does not support Lakehouse Federation."It seems that...
- 1079 Views
- 1 replies
- 0 kudos
- 0 kudos
Direct cloning of a vector index table may not be possible. However, if Databricks generates the embeddings, you can enable "Sync computed embeddings" to save them to a Unity Catalog table. Alternatively, you can set the parameter sync_computed_embed...
- 0 kudos
- 243 Views
- 0 replies
- 0 kudos
Vector search index creation is incredibly slow
I am trying to create a vector search index for a Delta Table using Azure OpenAI embeddings (text-embedding-3-large). The table contains 5000 chunks with approx. 1000 tokens each. The OpenAI embeddings are generated through a Databricks model serving...
- 243 Views
- 0 replies
- 0 kudos
- 267 Views
- 0 replies
- 0 kudos
Exception: The demo llm-rag-chatbot doesn't exist.
Hello,when I try to bring the demo environment (LLM Chatbot With Retrieval Augmented Generation (RAG) and DBRX) into my Databricks workspace, I get the following error: Exception: The demo llm-rag-chatbot doesn't exist.I execute the following code: %...
- 267 Views
- 0 replies
- 0 kudos
- 489 Views
- 4 replies
- 2 kudos
Building a Chatbot Assistant for Data Analysts Leveraging Unity Catalog
Hey everyone,I'm working on a project to enhance our data analysts' experience on the platform. In our company, we've done a great job with Unity Catalog, and we have comprehensive descriptions for all the tables and columns in our data lake.I'm inte...
- 489 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi MariuszK,I can confirm that the RAG architecture on Databricks works very well—we’ve taken it to production and are very satisfied with the results. As a first step, I'll try creating a Genie Room on the system table to see if it can help retrieve...
- 2 kudos
- 1548 Views
- 0 replies
- 0 kudos
Genie Space
Hi Team,I would like to use Genie to enable NLP on my delta lake. However, the documentation mention the limitation as 20 messages per minute for a workspace for all Genie Spaces.Is there a pay-as-go model for Genie Space?Regards,Ravi Kumar Singh
- 1548 Views
- 0 replies
- 0 kudos
- 290 Views
- 1 replies
- 0 kudos
Issues with Generating Synthetic Data Using the Mosaic AI API - 403 Permission Denied Error
Hi everyone,I’m currently working with the new Synthetic Data Generation API in Mosaic AI, and I’ve encountered an issue when trying to generate questions for a document. Specifically, I’m running into the following error:Failed to generate question...
- 290 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @aero_g, Looks like it is not supported on your region, but I will get more details internally.
- 0 kudos
- 463 Views
- 3 replies
- 0 kudos
Should elaborate and complex LLM apps be deployed as MLFlow serving endpoints?
In a project we are building increasingly complex LLM-based Apps (RAG, multi-agent workflows, langgraph, unstructured ingestion etc), and we are having doubts if these apps should be deployed as MLFlow-based endpoints. I would like your feedback on i...
- 463 Views
- 3 replies
- 0 kudos
- 0 kudos
Actually, maybe root folder was imprecise. The point is that it gets file system access. It becomes a regular Workspace user, with too much access. If, however, you want to give it specific accesses beyond that, you could give it access to specific v...
- 0 kudos
- 175 Views
- 1 replies
- 0 kudos
Error running mlflow.evaluate()
Hi Team,I am following below article to evaluate my model.What is Mosaic AI Agent Evaluation? | Databricks on AWSExample for my model is below:input_example = pd.DataFrame({ "text": ["What is the stoppage duration for January month 2024?"], "pa...
- 175 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Nawneet, Ensure that the input format for the agent evaluation matches the expected schema. Here is an example to structure your input data correctly: import mlflow import pandas as pd examples = { "request": [ {"messages": [{"ro...
- 0 kudos
- 407 Views
- 1 replies
- 1 kudos
I am struggling on complicated RAG code for Mosaic evaluation deployment
I want to know how I can apply some complicated RAG designs so I can directly deploy on the Mosaic AI evaluation UI. There are two cases:1. two or more index retrieval as independent tools (parallel retrievals)2.two index retrieval processes that dep...
- 407 Views
- 1 replies
- 1 kudos
- 341 Views
- 0 replies
- 0 kudos
How to serve a RAG chain endpoint that supports streaming
Hello everyone,I am trying to serve a sample RAG chain model that should support streaming output. But I could not find any documantation on how to enable streaming for a serving endpoint for a langchain model. Could you provide some hints on how to ...
- 341 Views
- 0 replies
- 0 kudos
- 549 Views
- 3 replies
- 0 kudos
Unable to log MLFlow run for LangChain chain while using databricks-langchain library
Whenever I try to log my run it throws me the following error: MlflowException: Failed to save runnable sequence: {'0': 'RunnableParallel<query,context> -- Failed to save runnable sequence: {\'context\': "RunnableSequence -- Failed to save runnable s...
- 549 Views
- 3 replies
- 0 kudos
- 761 Views
- 2 replies
- 0 kudos
LangGraph MemorySaver checkpointer usage with MLflow
Hi everyone.I am working on a graph that utilizes the MemorySaver class to incorporate short-term memory. This will enable me to maintain a multi-turn conversation with the user by storing the chat history.I am using the MLflow "models from code" fea...
- 761 Views
- 2 replies
- 0 kudos
- 0 kudos
To register a LangGraph graph in MLflow using MemorySaver for short-term memory, you can follow these steps:1. **Set up MemorySaver:** Create a `MemorySaver` checkpointer to enable persistent checkpointing, which saves the state of the graph after ea...
- 0 kudos
- 674 Views
- 4 replies
- 4 kudos
Model Serving and Streaming
Hi everyone,I have a question regarding the concurrency limitations of streaming responses from an LLM chain via Databricks Model Serving.When using a streaming response, the request remains open for the duration of the generation process. For exampl...
- 674 Views
- 4 replies
- 4 kudos
- 4 kudos
Wow, Thank you so much for your help.
- 4 kudos
Connect with Databricks Users in Your Area
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group-
agents
1 -
AI
1 -
chat history
1 -
Chatgpt
1 -
Databricks Course
1 -
Databricks SQL
1 -
Databricks-connect
1 -
Developer Experience
1 -
DLT Pipeline
1 -
Foundation Model
3 -
GenAI
1 -
GenAI agent
1 -
GenAI and Large Language Models (LLMs)
1 -
GenAI and LLMs
1 -
GenAIGeneration AI
23 -
GenAIGenerationAI
1 -
Generation AI
1 -
Generative AI
4 -
Genie
5 -
Genie - Notebook Access
2 -
Hello
1 -
Index
1 -
Knowledge Graph LLM
1 -
Langchain
3 -
LangGraph
1 -
machine-learning
1 -
MlFlow
3 -
Mlflow registry
1 -
Model Serving
2 -
Mosaic AI evaluation
1 -
RAG
2 -
Vector
1 -
Vector search index
4
- « Previous
- Next »
User | Count |
---|---|
7 | |
5 | |
4 | |
4 | |
4 |