- 29159 Views
- 18 replies
- 33 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 29159 Views
- 18 replies
- 33 kudos
- 5009 Views
- 7 replies
- 5 kudos
Genie Agent Integration in Databricks
I'm developing an Agent using the Cookbook template and would like to incorporate a Genie agent. I came across the Databricks GitHub repository and noticed they're actively working on it: GitHub - Genie Agent. However, it seems to be in the early sta...
- 5009 Views
- 7 replies
- 5 kudos
- 5 kudos
I think Teams/Slack channel as a chat bot will be more exciting use case. When we demoed the Genie to our executives we are in Retail Industry Client and we have lots of stores one of the thing they said is this would be awesome if this can be in Tea...
- 5 kudos
- 3837 Views
- 0 replies
- 0 kudos
Error when logging artifact OSError: [Errno 5] Input/output error: '/dbfs/Volumes'
Hi, I'm building an streamlit application on databricks apps, where user can upload some data , and I run an LLM model and return results. There, I want to log an artifact to a volume. I'm following this documentation https://docs.databricks.com/aws...
- 3837 Views
- 0 replies
- 0 kudos
- 5447 Views
- 5 replies
- 3 kudos
Resolved! How to integrate genie in with databricks apps
How to integrate genie in with databricks - data apps i want a chatbot that behaves like genie
- 5447 Views
- 5 replies
- 3 kudos
- 3783 Views
- 0 replies
- 0 kudos
Behavior of Vector Index Sync with Delta Tables When Using OVERWRITE vs MERGE in Databricks
I'm working with vector search in Databricks using vector index sync with Delta tables, and I'm a bit unclear on how updates to the source table affect the vector index, specifically when using different write operations.If I overwrite the source Del...
- 3783 Views
- 0 replies
- 0 kudos
- 6137 Views
- 4 replies
- 0 kudos
Resolved! LangGraph MemorySaver checkpointer usage with MLflow
Hi everyone.I am working on a graph that utilizes the MemorySaver class to incorporate short-term memory. This will enable me to maintain a multi-turn conversation with the user by storing the chat history.I am using the MLflow "models from code" fea...
- 6137 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @moemedina. No, I didn't.I'm considering using ChatModel/ChatAgent class to wrap the graph and be able to move on. However, the MLflow documentation is still referring to ChatModel where Chat Agent is the latest recommendation:MLflow ChatModel Doc...
- 0 kudos
- 1063 Views
- 1 replies
- 0 kudos
Metadata filtering mechanism in Databricks Vector Search
Does Databricks vector search support pre-filtering or post-filtering or both in metadata filtering?
- 1063 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @SaiVihAI, Yes, It uses in-query filtering. The algorithm takes a series of iterative steps to determine if the filtered set is small enough to execute brute-force search or if it proceeds with AN
- 0 kudos
- 3408 Views
- 0 replies
- 0 kudos
Custom sentence transformer for indexing
Hi! i would like to use my own sentence transformer to create a vector index. It is not a problem using mlflow sentence-transformer flavour, it works fine with: mlflow.sentence_transformers.log_model( model, artifact_path="model", signatu...
- 3408 Views
- 0 replies
- 0 kudos
- 3296 Views
- 0 replies
- 1 kudos
AI_QUERY fails with o1-mini
As of sometime between March 7th and March 12, the AI_QUERY function has become very temperamental with Azure OpenAI models.Asking a basic question of our Mosaic AI o1-mini serving endpoint using AI_QUERY causes an error sometimes but not every time:...
- 3296 Views
- 0 replies
- 1 kudos
- 4948 Views
- 2 replies
- 2 kudos
Serving endpoint with external model (azure openai) is throwing "Public network access is disable "
Databricks serving endpoint is not working as expected throwing an exception as "Public network access is disable, Create private endpoints".We have create the azure openAI resource with public network access disabled, but also we have created the pr...
- 4948 Views
- 2 replies
- 2 kudos
- 2 kudos
Serving endpoints with external models will require creating Network Connectivity Configuration objects at the account level to connect to the Azure OpenAI resource. The feature is currently in private preview, please reach out to your Databricks acc...
- 2 kudos
- 4331 Views
- 1 replies
- 0 kudos
Copying/cloning Vector index table
Regarding copying or cloning vector index tables, it appears that direct copying or cloning is not possible, as Databricks throws the message: "Securable with kind TABLE_ONLINE_VECTOR_INDEX_REPLICA does not support Lakehouse Federation."It seems that...
- 4331 Views
- 1 replies
- 0 kudos
- 0 kudos
Direct cloning of a vector index table may not be possible. However, if Databricks generates the embeddings, you can enable "Sync computed embeddings" to save them to a Unity Catalog table. Alternatively, you can set the parameter sync_computed_embed...
- 0 kudos
- 3279 Views
- 0 replies
- 0 kudos
Exception: The demo llm-rag-chatbot doesn't exist.
Hello,when I try to bring the demo environment (LLM Chatbot With Retrieval Augmented Generation (RAG) and DBRX) into my Databricks workspace, I get the following error: Exception: The demo llm-rag-chatbot doesn't exist.I execute the following code: %...
- 3279 Views
- 0 replies
- 0 kudos
- 2085 Views
- 4 replies
- 2 kudos
Building a Chatbot Assistant for Data Analysts Leveraging Unity Catalog
Hey everyone,I'm working on a project to enhance our data analysts' experience on the platform. In our company, we've done a great job with Unity Catalog, and we have comprehensive descriptions for all the tables and columns in our data lake.I'm inte...
- 2085 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi MariuszK,I can confirm that the RAG architecture on Databricks works very well—we’ve taken it to production and are very satisfied with the results. As a first step, I'll try creating a Genie Room on the system table to see if it can help retrieve...
- 2 kudos
- 12733 Views
- 0 replies
- 0 kudos
Genie Space
Hi Team,I would like to use Genie to enable NLP on my delta lake. However, the documentation mention the limitation as 20 messages per minute for a workspace for all Genie Spaces.Is there a pay-as-go model for Genie Space?Regards,Ravi Kumar Singh
- 12733 Views
- 0 replies
- 0 kudos
- 911 Views
- 1 replies
- 0 kudos
Issues with Generating Synthetic Data Using the Mosaic AI API - 403 Permission Denied Error
Hi everyone,I’m currently working with the new Synthetic Data Generation API in Mosaic AI, and I’ve encountered an issue when trying to generate questions for a document. Specifically, I’m running into the following error:Failed to generate question...
- 911 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @aero_g, Looks like it is not supported on your region, but I will get more details internally.
- 0 kudos
- 1241 Views
- 3 replies
- 0 kudos
Should elaborate and complex LLM apps be deployed as MLFlow serving endpoints?
In a project we are building increasingly complex LLM-based Apps (RAG, multi-agent workflows, langgraph, unstructured ingestion etc), and we are having doubts if these apps should be deployed as MLFlow-based endpoints. I would like your feedback on i...
- 1241 Views
- 3 replies
- 0 kudos
- 0 kudos
Actually, maybe root folder was imprecise. The point is that it gets file system access. It becomes a regular Workspace user, with too much access. If, however, you want to give it specific accesses beyond that, you could give it access to specific v...
- 0 kudos
