- 23205 Views
- 14 replies
- 24 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 23205 Views
- 14 replies
- 24 kudos
- 65 Views
- 1 replies
- 1 kudos
Insufficient Permission Error When Serving RAG Model with Multiple Vector Search Indexes
Hi Community,I’m currently working on a Retrieval-Augmented Generation (RAG) use case in Databricks. I’ve successfully implemented and served a model that uses a single Vector Search index, and everything works as expected.However, when I try to serv...
- 65 Views
- 1 replies
- 1 kudos
- 1 kudos
@Karthik_Karanm This is a known issue pattern when using multiple Unity Catalog (UC) vector search indexes inDatabricks Model Serving — especially under MLflow model serving endpoints with RAG architecture.Your model serving environment (i.e., the mo...
- 1 kudos
- 5706 Views
- 10 replies
- 0 kudos
Gen AI course material
Databricks updated the Generative AI course https://partner-academy.databricks.com/learn/lp/315/generative-ai-engineering-pathway but the course material is missing in the partner academy. Does anybody know where to download the course material?
- 5706 Views
- 10 replies
- 0 kudos
- 0 kudos
This course is available in the Academy. The link may be different if you are in Customer, Partner, or general Academy. You should be able to find it by searching the course catalog for "Databricks Generative AI Fundamentals Learning Plan"
- 0 kudos
- 104 Views
- 1 replies
- 0 kudos
Unable to read message from Genie Conversation API
Hi Team,I am facing issue in getting the message details from the genie conversation API. I have created the conversation, which returns the message ID and conversation ID. But I am unable to see the message. I am getting error, when hitting the Get ...
- 104 Views
- 1 replies
- 0 kudos
- 0 kudos
@RitikaKulshrest I can see what's happening with your Genie conversation API issue. The problem is not with your API call but with the Genie service's attempt to execute your query.The response indicates that your message was received but failed to p...
- 0 kudos
- 23205 Views
- 14 replies
- 24 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 23205 Views
- 14 replies
- 24 kudos
- 143 Views
- 3 replies
- 0 kudos
Genie Agent integration issue
Hi, anyone from development team for Genie Agent integration? i had an issue of using sample code of Genie Agent integration. The issue is that underlying code (databricks_ai_bridge/genie.py) cannot connect to url openaipublic.blob.core.windows.net ...
- 143 Views
- 3 replies
- 0 kudos
- 0 kudos
You're absolutely right. The implementation should definitely take restricted network scenarios into consideration, as many enterprise Databricks deployments operate in air-gapped or network-restricted environments.Commenting out the token counting l...
- 0 kudos
- 514 Views
- 2 replies
- 2 kudos
Resolved! LLM with the largest context window
A Generative AI Engineer is tasked with developing an application that is based on an open-source large language model (LLM). They need a foundation LLM with a large context window. Which model fits this need?DBRX,Llama2-70B,DistilBert MPT-30B.DBRX h...
- 514 Views
- 2 replies
- 2 kudos
- 2 kudos
@royinblr11 You're absolutely right to question the answer — the correct model for an application needing a foundation LLM with a large context window is: DBRXWhy DBRX is the Best Fit:It is a foundation model, designed for generation tasks.It support...
- 2 kudos
- 317 Views
- 3 replies
- 0 kudos
Are serverless endpoints possible in this Technical Blog post by qianyu?
Hi, are serverless endpoints possible for Whisper and Llama in this Technical Blog post by qianyu?https://community.databricks.com/t5/technical-blog/streamline-customer-call-center-transcripts-analytics-with/ba-p/101689Thanks!
- 317 Views
- 3 replies
- 0 kudos
- 0 kudos
https://www.databricks.com/product/pricing/foundation-model-servingWe don´t serve models on databricks, but as far as i can see you pay per input/output tokens (for foundation models).For classic models:https://www.databricks.com/product/pricing/mode...
- 0 kudos
- 260 Views
- 0 replies
- 0 kudos
Whether Databricks has any plans to Integrate Databricks Genie with Azure OpenAI?
Hi,I am checking to see if Databricks has any plans to Integrate Databricks Genie with Azure OpenAI? as I know Databricks Genie is designed to work with Databricks' data ecosystem itself. But is there any plans to enhance this capability where we can...
- 260 Views
- 0 replies
- 0 kudos
- 1173 Views
- 1 replies
- 0 kudos
Langchain SQLDatabase not fetching column names from table in Unity Catalog
I am building a text-to-sql agent using Langchain API.I created a SQLDatabase using: db = SQLDatabase.from_databricks(catalog="`my-catalog-name`", schema="my_schema", host="...", api_token="...", warehouse_id="12345678")When I call db.get_table_info(...
- 1173 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi there,I am facing the similar issue. Were you able to fix this?
- 0 kudos
- 650 Views
- 4 replies
- 2 kudos
Resolved! MLFlow Authentication from Databricks App for GenAI Tracing
I am working on a Dash-based app that includes a call to a Databricks-hosted LLM endpoint. I am trying to track those calls with MLFlow. My code is (roughly) like this:from openai import OpenAIimport mlflowmlflow.set_tracking_uri("databricks")mlflow....
- 650 Views
- 4 replies
- 2 kudos
- 2 kudos
Thank you for the push in the right direction! I was able to solve the issue with this codeos.environ["DATABRICKS_CLIENT_ID"] = "" os.environ["DATABRICKS_CLIENT_SECRET"] = "" os.environ["DATABRICKS_TOKEN"] = os.environ.get("VAR_CONFIGURED_WITH_DATABR...
- 2 kudos
- 4024 Views
- 2 replies
- 0 kudos
AI/BI Genie API
Hi everyone,I'm currently working on a project that implements a custom front end for Genie using the Genie API: https://docs.databricks.com/api/workspace/genie. So far, I’ve successfully built a working model that can send and receive messages.Howev...
- 4024 Views
- 2 replies
- 0 kudos
- 0 kudos
Is there any possibility that workspace admin could have removed this permission to you? If you check the permissions on your side do you see yourself with at least Can View?
- 0 kudos
- 519 Views
- 1 replies
- 0 kudos
Roadmap for vector_search function
I was wondering if there was a roadmap for the development of the vector_search function: vector_search function | Databricks DocumentationSpecifically, I was wondering if / when the following limitations may be lifted:Querying DIRECT_ACCESS index ty...
- 519 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @jAAmes_bentley, DIRECT_ACCESS & filters_json are not currently supported with vector_search sql function. These are on our roadmap, but we don’t have concrete ETAs to share at the moment as we’re focusing on other high-priority tasks. Hybrid s...
- 0 kudos
- 722 Views
- 1 replies
- 0 kudos
How to do NLP against PDFs in Databricks? Can be done in Snowflake very easily.
I’d love to build a quick "art of the possible" demo showing how easy it is to query unstructured PDFs using natural language. In Snowflake, I wired up a similar solution in ~2 hours just by following their tutorial guide.Does anyone know the best wa...
- 722 Views
- 1 replies
- 0 kudos
- 0 kudos
To query unstructured PDF files using natural language in Databricks, you can leverage an approach similar to the "Retrieval Augmented Generation (RAG) and DBRX" demo. Although the specific demo you referenced (https://notebooks.databricks.com/demos/...
- 0 kudos
- 623 Views
- 4 replies
- 3 kudos
LangChain Compatibility in Databricks – Painfully Inconsistent Experience
Hey all,Is anyone else experiencing major friction when using LangChain within Databricks?Even after carefully pinning versions like:%pip install \ loguru \ mlflow==2.10.1 \ langchain==0.1.5 \ langchain-google-vertexai \ databricks-vectorse...
- 623 Views
- 4 replies
- 3 kudos
- 3 kudos
I'll definitely look into installing libraries at the cluster level via init scripts makes a lot of sense for stability and reproducibility. I hadn't considered that approach, so I really appreciate you highlighting that and providing the relevant Da...
- 3 kudos
- 471 Views
- 0 replies
- 0 kudos
How to use `predict_stream` in Databricks deployed ChatAgent.
Hello,We are working on a solution to have a streaming chat agent. Our agent works fine in the Playground but when we try to call it as an api under /invocations, the streaming does not work.
- 471 Views
- 0 replies
- 0 kudos
