- 28340 Views
- 18 replies
- 32 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 28340 Views
- 18 replies
- 32 kudos
- 1300 Views
- 2 replies
- 1 kudos
Resolved! ProgramOfThought module in Dspy error in Databricks notebooks
This module uses deno, but even after installing it. I get a permissions error. Anyone encountered this before?Failed to run ProgramOfThought: [Errno 13] Permission denied: 'deno'
- 1300 Views
- 2 replies
- 1 kudos
- 1 kudos
Got it working @Renu_ I needed to add the permissions in my notebook as I am on serverless. import ospath = "/local_disk0/.ephemeral_nfs/envs/{Python_Env_instance}/bin/deno"os.chmod(path, 0o777)
- 1 kudos
- 1360 Views
- 1 replies
- 1 kudos
Is the basic model considering adding Claude 4 Opus?
Is the basic model considering adding Claude 4 Opus? It should be the strongest model in the world right now, and AWS already supports it.
- 1360 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @ninicky, Databricks has recently integrated Anthropic's latest models, Claude Opus 4 into our platform as part of a partnership with Anthropic announced on March 26, 2025. Opus will be available in Databricks Mosaic AI as additional first-par...
- 1 kudos
- 2176 Views
- 2 replies
- 0 kudos
Issue with RAG - Review app - endpoint failed to stream the response
Hi Databricks Support,I am facing issue for using - RAG review app endpoint url. Error message: The endpoint failed to stream the response. Retrying without streaming.The RAG endpoint url was created earlier and it worked with review app, at the time...
- 2176 Views
- 2 replies
- 0 kudos
- 0 kudos
Can you share error details? I updated it without an porblme using mlflow.
- 0 kudos
- 10036 Views
- 1 replies
- 1 kudos
Resolved! ai_query issue
As per the doc , one can execute an ai_query in python. But I am sot sure why I can'tWorks in SQLselect 1 as colA, ai_query('databricks-llama-4-maverick', 'what is 2+2') as testBut not in sparkdf = spark.sql("select 1 as colA") df = df.selectExpr(""...
- 10036 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @smpa01, I tried to reproduce this issue internally and it worked for me as expected in spark as well. I am sharing below screenshot for your reference: I used DBR 15.4 LTS and serverless it worked on both
- 1 kudos
- 1087 Views
- 2 replies
- 0 kudos
Questions about the Knowledge Assistant during agentBrick
hello.I'm testing agentBricks right now. As I'm testing, I have a few questions that I'd like to ask.1) Is it possible to input the schema in a format with input and output?2) In the free trial, when I create a vector search index and utilize it as a...
- 1087 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Remy, Yes, you can define input and output schemas in Databricks, typically using formats like Python dictionaries, especially when working with Vector Search indexes.Free Edition allows only one Vector Search endpoint per workspace, so creating ...
- 0 kudos
- 681 Views
- 0 replies
- 0 kudos
streaming llm response
I am deploying an agent that works good withouth streaming:it is using the following packages: "mlflow==2.22.1", "langgraph", "langchain", "pydantic==2.8.2", "langgraph-checkpoint-sqlite", "databricks-langchain", "p...
- 681 Views
- 0 replies
- 0 kudos
- 5465 Views
- 1 replies
- 0 kudos
How to use `predict_stream` in Databricks deployed ChatAgent.
Hello,We are working on a solution to have a streaming chat agent. Our agent works fine in the Playground but when we try to call it as an api under /invocations, the streaming does not work.
- 5465 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @jcastro I wish you a wonderful day ahead! Databricks recommends the MLflow ChatAgent interface to author production-grade agents. These ChatAgent provides advanced agent capabilities like Streaming output to enable interactive user experiences...
- 0 kudos
- 136317 Views
- 12 replies
- 11 kudos
AI/BI Genie - Call
HiIs there any way to call a Genie space from a notebook and get the response ? Is there any API available?#genie, #databricksgenie, #databricks_genie
- 136317 Views
- 12 replies
- 11 kudos
- 11 kudos
Here's the GEnie API Docs - currently in public preview. > Genie API | REST API reference | Databricks on AWSYou can connect to your Genie Spaces and interact with it programmatically.
- 11 kudos
- 644 Views
- 0 replies
- 0 kudos
DatabricksVectorSearch seems to crash when served
Hey y'all !So I'm experimenting with the Databricks' DatanircksVectorSearch class in Python to serve as a tool that can be used by an agent. When I run it on a notebook, I get the following error:"[NOTICE] Using a notebook authentication token. Recom...
- 644 Views
- 0 replies
- 0 kudos
- 2657 Views
- 1 replies
- 1 kudos
Resolved! Delta Sync index - Slow Sync Performance from Delta Table to Mosaic AI Vector
I'm currently working with Mosaic AI Vector Search on Databricks and using a Delta Sync index (TRIGGERED) to sync from a Delta table (with embedding column already precomputed) to a vector index.However, I'm noticing the sync process is quite slow Ro...
- 2657 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @amitkumarvish , I wish you a wonderful day ahead! This could be due to dimension mismatch between precomputed embeddings and index expectations or due to storing unnecessary metadata columns or binary data in metadata fields which may creates ...
- 1 kudos
- 10781 Views
- 3 replies
- 3 kudos
Lets talk genAI
Im Jose and lets talk genAI
- 10781 Views
- 3 replies
- 3 kudos
- 465 Views
- 1 replies
- 0 kudos
How to build MLOps
How to use Databricks to build MLOps
- 465 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @hemeiling, To build MLOps on Databricks, you can manage the full machine learning lifecycle in one unified platform. Start by preparing your data using Delta Lake and notebooks. Then, train and track models using MLflow, which lets you log metric...
- 0 kudos
- 3734 Views
- 2 replies
- 0 kudos
Vector search index creation is incredibly slow
I am trying to create a vector search index for a Delta Table using Azure OpenAI embeddings (text-embedding-3-large). The table contains 5000 chunks with approx. 1000 tokens each. The OpenAI embeddings are generated through a Databricks model serving...
- 3734 Views
- 2 replies
- 0 kudos
- 0 kudos
@epistoteles I am also facing the same issue while delta table sync with Index. Could you please share if you have any work around or used some different appoarch to decrease latency.Thanks in advance.
- 0 kudos
- 383 Views
- 0 replies
- 0 kudos
Utilizing Genie AI with Workflows
As subject says, is this possible via creating a python script that calls agent.predict etc...? Similar to thisagent.predict( { "messages": [{"role": "user", "content": "...the question we want to ask Genie..."}], } )I want to implement Genie AI, and...
- 383 Views
- 0 replies
- 0 kudos
- 2101 Views
- 1 replies
- 0 kudos
Resolved! Azure Databricks: Where are foundation models hosted
In the updated Supported models for Databricks Foundation Models APIs - Azure Databricks | Microsoft Learn document, it's stated that Claude 3.7 and 4 Opus are " hosted by Databricks Inc. in AWS". Is that accurate for Azure Databricks, or is there a...
- 2101 Views
- 1 replies
- 0 kudos
- 0 kudos
Claude is not hosted on Azure. Only Amazon Bedrock and Google Cloud's Vertex AI. Databricks hosts it through AWS within their security perimeter; i.e., requests go through Amazon Bedrock (Fig. 1), as indicated by the model name in AWS format and the ...
- 0 kudos
