- 29072 Views
- 18 replies
- 33 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 29072 Views
- 18 replies
- 33 kudos
- 1402 Views
- 1 replies
- 1 kudos
Is the basic model considering adding Claude 4 Opus?
Is the basic model considering adding Claude 4 Opus? It should be the strongest model in the world right now, and AWS already supports it.
- 1402 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @ninicky, Databricks has recently integrated Anthropic's latest models, Claude Opus 4 into our platform as part of a partnership with Anthropic announced on March 26, 2025. Opus will be available in Databricks Mosaic AI as additional first-par...
- 1 kudos
- 2255 Views
- 2 replies
- 0 kudos
Issue with RAG - Review app - endpoint failed to stream the response
Hi Databricks Support,I am facing issue for using - RAG review app endpoint url. Error message: The endpoint failed to stream the response. Retrying without streaming.The RAG endpoint url was created earlier and it worked with review app, at the time...
- 2255 Views
- 2 replies
- 0 kudos
- 0 kudos
Can you share error details? I updated it without an porblme using mlflow.
- 0 kudos
- 11010 Views
- 1 replies
- 1 kudos
Resolved! ai_query issue
As per the doc , one can execute an ai_query in python. But I am sot sure why I can'tWorks in SQLselect 1 as colA, ai_query('databricks-llama-4-maverick', 'what is 2+2') as testBut not in sparkdf = spark.sql("select 1 as colA") df = df.selectExpr(""...
- 11010 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @smpa01, I tried to reproduce this issue internally and it worked for me as expected in spark as well. I am sharing below screenshot for your reference: I used DBR 15.4 LTS and serverless it worked on both
- 1 kudos
- 1171 Views
- 2 replies
- 0 kudos
Questions about the Knowledge Assistant during agentBrick
hello.I'm testing agentBricks right now. As I'm testing, I have a few questions that I'd like to ask.1) Is it possible to input the schema in a format with input and output?2) In the free trial, when I create a vector search index and utilize it as a...
- 1171 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Remy, Yes, you can define input and output schemas in Databricks, typically using formats like Python dictionaries, especially when working with Vector Search indexes.Free Edition allows only one Vector Search endpoint per workspace, so creating ...
- 0 kudos
- 5764 Views
- 1 replies
- 0 kudos
How to use `predict_stream` in Databricks deployed ChatAgent.
Hello,We are working on a solution to have a streaming chat agent. Our agent works fine in the Playground but when we try to call it as an api under /invocations, the streaming does not work.
- 5764 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @jcastro I wish you a wonderful day ahead! Databricks recommends the MLflow ChatAgent interface to author production-grade agents. These ChatAgent provides advanced agent capabilities like Streaming output to enable interactive user experiences...
- 0 kudos
- 146804 Views
- 12 replies
- 11 kudos
AI/BI Genie - Call
HiIs there any way to call a Genie space from a notebook and get the response ? Is there any API available?#genie, #databricksgenie, #databricks_genie
- 146804 Views
- 12 replies
- 11 kudos
- 11 kudos
Here's the GEnie API Docs - currently in public preview. > Genie API | REST API reference | Databricks on AWSYou can connect to your Genie Spaces and interact with it programmatically.
- 11 kudos
- 694 Views
- 0 replies
- 0 kudos
DatabricksVectorSearch seems to crash when served
Hey y'all !So I'm experimenting with the Databricks' DatanircksVectorSearch class in Python to serve as a tool that can be used by an agent. When I run it on a notebook, I get the following error:"[NOTICE] Using a notebook authentication token. Recom...
- 694 Views
- 0 replies
- 0 kudos
- 2974 Views
- 1 replies
- 1 kudos
Resolved! Delta Sync index - Slow Sync Performance from Delta Table to Mosaic AI Vector
I'm currently working with Mosaic AI Vector Search on Databricks and using a Delta Sync index (TRIGGERED) to sync from a Delta table (with embedding column already precomputed) to a vector index.However, I'm noticing the sync process is quite slow Ro...
- 2974 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @amitkumarvish , I wish you a wonderful day ahead! This could be due to dimension mismatch between precomputed embeddings and index expectations or due to storing unnecessary metadata columns or binary data in metadata fields which may creates ...
- 1 kudos
- 10832 Views
- 3 replies
- 3 kudos
Lets talk genAI
Im Jose and lets talk genAI
- 10832 Views
- 3 replies
- 3 kudos
- 497 Views
- 1 replies
- 0 kudos
How to build MLOps
How to use Databricks to build MLOps
- 497 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @hemeiling, To build MLOps on Databricks, you can manage the full machine learning lifecycle in one unified platform. Start by preparing your data using Delta Lake and notebooks. Then, train and track models using MLflow, which lets you log metric...
- 0 kudos
- 4019 Views
- 2 replies
- 0 kudos
Vector search index creation is incredibly slow
I am trying to create a vector search index for a Delta Table using Azure OpenAI embeddings (text-embedding-3-large). The table contains 5000 chunks with approx. 1000 tokens each. The OpenAI embeddings are generated through a Databricks model serving...
- 4019 Views
- 2 replies
- 0 kudos
- 0 kudos
@epistoteles I am also facing the same issue while delta table sync with Index. Could you please share if you have any work around or used some different appoarch to decrease latency.Thanks in advance.
- 0 kudos
- 409 Views
- 0 replies
- 0 kudos
Utilizing Genie AI with Workflows
As subject says, is this possible via creating a python script that calls agent.predict etc...? Similar to thisagent.predict( { "messages": [{"role": "user", "content": "...the question we want to ask Genie..."}], } )I want to implement Genie AI, and...
- 409 Views
- 0 replies
- 0 kudos
- 2214 Views
- 1 replies
- 0 kudos
Resolved! Azure Databricks: Where are foundation models hosted
In the updated Supported models for Databricks Foundation Models APIs - Azure Databricks | Microsoft Learn document, it's stated that Claude 3.7 and 4 Opus are " hosted by Databricks Inc. in AWS". Is that accurate for Azure Databricks, or is there a...
- 2214 Views
- 1 replies
- 0 kudos
- 0 kudos
Claude is not hosted on Azure. Only Amazon Bedrock and Google Cloud's Vertex AI. Databricks hosts it through AWS within their security perimeter; i.e., requests go through Amazon Bedrock (Fig. 1), as indicated by the model name in AWS format and the ...
- 0 kudos
- 3128 Views
- 6 replies
- 1 kudos
Claude Opus not available in Databricks?
https://docs.databricks.com/aws/en/machine-learning/foundation-model-apis/supported-modelsOpus is listed here as available model, but I only see Sonnet 4 in Databricks?
- 3128 Views
- 6 replies
- 1 kudos
- 1 kudos
Hi @kingn718 , Can you check to see if your workspace is in a supported region? Right now, Opus is only availble in us-east-1, us-east-2 and us-west-2 per https://docs.databricks.com/aws/en/machine-learning/model-serving/foundation-model-overview. If...
- 1 kudos
- 1549 Views
- 4 replies
- 2 kudos
Using Genie in Multi-Agent Systems — SQL Query Missing from Output
Hi Community,I’ve implemented a multi-agent system using Genie in Databricks, following the guide on "Use Genie in multi-agent systems | Databricks Documentation". The system integrates well with vector indexes, and everything works fine during model...
- 1549 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Karthik_Karanm,As per my understanding, the issue seems to be that the conversation state or authentication context isn’t being properly passed between agents in the multi-agent setup.A few things you might try:Avoid caching session or conversati...
- 2 kudos
