Databricks Community is an open-source platform for data enthusiasts and professionals to discuss, share insights, and collaborate on everything related to Databricks. Members can ask questions, share knowledge, and support each other in an environment that ensures respectful interactions.
Hi Community, I’m currently working on a Retrieval-Augmented Generation (RAG) use case in Databricks. I’ve successfully implemented and served a model that uses a single Vector Search index, and eve...
A Generative AI Engineer is tasked with developing an application that is based on an open-source large language model (LLM). They need a foundation LLM with a large context window. Which model fits ...
I am working on a Dash-based app that includes a call to a Databricks-hosted LLM endpoint. I am trying to track those calls with MLFlow. My code is (roughly) like this: from openai import OpenAI im...
Hi Team, I am new to Databricks and working on Gen AI requirements. Task - Build custom prompt with set of instructions to classify incident e.g. False Positive or True Positive. Input will be c...
Hi I came across the blog Deploying Deepseek-R1-Distilled-Llama Models on Databricks at https://www.databricks.com/blog/deepseek-r1-databricks I am new to using custom models that are not ...
Hi, I passed Databricks Certified Generative AI Engineer Associate exam yesterday and I havent received certificate. I verified my accredible account but it is not reflecting. In fact, there are...
....strace.enabled` to true.
25/01/10 18:49:01 INFO MlflowAutologEventPublisher$: Subscriber with repl ID ReplId-19450-b9978-b not responding to health checks, removing it
25/01/10 18:49:03 INFO P...
I am currently exploring the possibility of using Databricks AI Genie to allow layman users to ask questions and retrieve data on their own. We would like to keep the data in our warehouse (e.g., Sn...
I created a RAG using a corpus of pdf which I have on ADLS. Now where will the chunked text and vector embedding be stored once I parse all the PDFs and I want to start retrieval?