cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 31377 Views
  • 19 replies
  • 37 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 31377 Views
  • 19 replies
  • 37 kudos
Latest Reply
Poorva21
New Contributor III
  • 37 kudos

This is an exciting step forward from Databricks! Looking forward to diving into the curriculum and exploring what's next in the world of data + AI! Thanks for sharing @Sujitha 

  • 37 kudos
18 More Replies
vedants
by New Contributor
  • 1872 Views
  • 1 replies
  • 0 kudos

Databricks MCP to VsCode

HelloI was hoping for some guidance on databricks MCP configuration?I understand it is in Beta release.I would like to understand- authenticating databricks with vscode- mcp server config to add in vscode

  • 1872 Views
  • 1 replies
  • 0 kudos
Latest Reply
charlie_wei
New Contributor III
  • 0 kudos

Connecting VS Code and GitHub Copilot to the Databricks Managed MCP Server 

  • 0 kudos
prakashhinduja
by New Contributor III
  • 1695 Views
  • 1 replies
  • 4 kudos

Resolved! Introduction of Prakash Hinduja Switzerland (Swiss)

Hi Everyone, I'm Prakash Hinduja from Geneva, Switzerland (Swiss), I'm a financial strategist with deep experience in both traditional and emerging markets, I help clients build and preserve wealth through high-impact strategies in sustainable energy...

  • 1695 Views
  • 1 replies
  • 4 kudos
Latest Reply
Advika
Community Manager
  • 4 kudos

Welcome to the community, @prakashhinduja, it's great to have you with us! As you explore the Community, be sure to check out the Technical Blogs, to explore in-depth articles and real-world use cases. If you have any technical questions, post them u...

  • 4 kudos
Malthe
by Contributor III
  • 1915 Views
  • 2 replies
  • 1 kudos

Resolved! View inheritance of table and column comments

Reading through the documentation and searching in the community forum, I'm getting conflicting information on how views might inherit table and column comments from the underlying tables in a Genie context.My question is, to what extent does Genie p...

  • 1915 Views
  • 2 replies
  • 1 kudos
Latest Reply
lingareddy_Alva
Honored Contributor III
  • 1 kudos

Hi @Malthe Based on the current understanding of Genie's behavior:Comment Inheritance in Genie ViewsWhat Genie typically inherits:- Column descriptions from underlying tables are often picked up automatically- Basic column metadata (data types, nulla...

  • 1 kudos
1 More Replies
sengkchu
by New Contributor III
  • 1590 Views
  • 2 replies
  • 1 kudos

Resolved! ProgramOfThought module in Dspy error in Databricks notebooks

This module uses deno, but even after installing it. I get a permissions error. Anyone encountered this before?Failed to run ProgramOfThought: [Errno 13] Permission denied: 'deno'

  • 1590 Views
  • 2 replies
  • 1 kudos
Latest Reply
sengkchu
New Contributor III
  • 1 kudos

Got it working @Renu_  I needed to add the permissions in my notebook as I am on serverless. import ospath = "/local_disk0/.ephemeral_nfs/envs/{Python_Env_instance}/bin/deno"os.chmod(path, 0o777)

  • 1 kudos
1 More Replies
ninicky
by New Contributor II
  • 1640 Views
  • 1 replies
  • 1 kudos

Is the basic model considering adding Claude 4 Opus?

Is the basic model considering adding Claude 4 Opus? It should be the strongest model in the world right now, and AWS already supports it.

  • 1640 Views
  • 1 replies
  • 1 kudos
Latest Reply
Vinay_M_R
Databricks Employee
  • 1 kudos

Hello @ninicky, Databricks has recently integrated Anthropic's latest models, Claude Opus 4 into our platform as part of a partnership with Anthropic announced on March 26, 2025.  Opus will be available in Databricks Mosaic AI as additional first-par...

  • 1 kudos
RadhikRajendran
by New Contributor II
  • 2576 Views
  • 2 replies
  • 0 kudos

Issue with RAG - Review app - endpoint failed to stream the response

Hi Databricks Support,I am facing issue for using - RAG review app endpoint url. Error message: The endpoint failed to stream the response. Retrying without streaming.The RAG endpoint url was created earlier and it worked with review app, at the time...

  • 2576 Views
  • 2 replies
  • 0 kudos
Latest Reply
MariuszK
Valued Contributor III
  • 0 kudos

Can you share error details? I updated it without an porblme using mlflow.

  • 0 kudos
1 More Replies
smpa01
by Contributor
  • 11406 Views
  • 1 replies
  • 1 kudos

Resolved! ai_query issue

As per  the doc , one can execute an ai_query in python. But I am sot sure why I can'tWorks in SQLselect 1 as colA, ai_query('databricks-llama-4-maverick', 'what is 2+2') as testBut not in sparkdf = spark.sql("select 1 as colA") df = df.selectExpr(""...

  • 11406 Views
  • 1 replies
  • 1 kudos
Latest Reply
Vinay_M_R
Databricks Employee
  • 1 kudos

Hello @smpa01, I tried to reproduce this issue internally and it worked for me as expected in spark as well. I am sharing below screenshot for your reference: I used DBR 15.4 LTS and serverless it worked on both

  • 1 kudos
Remy
by New Contributor II
  • 1492 Views
  • 2 replies
  • 0 kudos

Questions about the Knowledge Assistant during agentBrick

hello.I'm testing agentBricks right now. As I'm testing, I have a few questions that I'd like to ask.1) Is it possible to input the schema in a format with input and output?2) In the free trial, when I create a vector search index and utilize it as a...

  • 1492 Views
  • 2 replies
  • 0 kudos
Latest Reply
Renu_
Valued Contributor II
  • 0 kudos

Hi @Remy, Yes, you can define input and output schemas in Databricks, typically using formats like Python dictionaries, especially when working with Vector Search indexes.Free Edition allows only one Vector Search endpoint per workspace, so creating ...

  • 0 kudos
1 More Replies
jcastro
by New Contributor
  • 6414 Views
  • 1 replies
  • 0 kudos

How to use `predict_stream` in Databricks deployed ChatAgent.

Hello,We are working on a solution to have a streaming chat agent. Our agent works fine in the Playground but when we try to call it as an api under /invocations, the streaming does not work. 

  • 6414 Views
  • 1 replies
  • 0 kudos
Latest Reply
Vinay_M_R
Databricks Employee
  • 0 kudos

Hello @jcastro I wish you a wonderful day ahead! Databricks recommends the MLflow ChatAgent interface to author production-grade agents. These ChatAgent provides advanced agent capabilities like Streaming output to enable interactive user experiences...

  • 0 kudos
MattB
by New Contributor III
  • 160101 Views
  • 12 replies
  • 11 kudos

AI/BI Genie - Call

HiIs there any way to call a Genie space from a notebook and get the response ? Is there any API available?#genie, #databricksgenie, #databricks_genie

  • 160101 Views
  • 12 replies
  • 11 kudos
Latest Reply
tomtillo
New Contributor II
  • 11 kudos

Here's the GEnie API Docs - currently in public preview. > Genie API | REST API reference | Databricks on AWSYou can connect to your Genie Spaces and interact with it programmatically.  

  • 11 kudos
11 More Replies
amitkumarvish
by New Contributor II
  • 3745 Views
  • 1 replies
  • 1 kudos

Resolved! Delta Sync index - Slow Sync Performance from Delta Table to Mosaic AI Vector

I'm currently working with Mosaic AI Vector Search on Databricks and using a Delta Sync index (TRIGGERED) to sync from a Delta table (with embedding column already precomputed) to a vector index.However, I'm noticing the sync process is quite slow Ro...

  • 3745 Views
  • 1 replies
  • 1 kudos
Latest Reply
Vinay_M_R
Databricks Employee
  • 1 kudos

Hello @amitkumarvish , I wish you a wonderful day ahead! This could be due to dimension mismatch between precomputed embeddings and index expectations or due to storing unnecessary metadata columns or binary data in metadata fields which may creates ...

  • 1 kudos
hemeiling
by New Contributor
  • 676 Views
  • 1 replies
  • 0 kudos

How to build MLOps

How to use Databricks to build MLOps

  • 676 Views
  • 1 replies
  • 0 kudos
Latest Reply
Renu_
Valued Contributor II
  • 0 kudos

Hi @hemeiling, To build MLOps on Databricks, you can manage the full machine learning lifecycle in one unified platform. Start by preparing your data using Delta Lake and notebooks. Then, train and track models using MLflow, which lets you log metric...

  • 0 kudos
Rjdudley
by Honored Contributor
  • 2847 Views
  • 1 replies
  • 0 kudos

Resolved! Azure Databricks: Where are foundation models hosted

In the updated Supported models for Databricks Foundation Models APIs - Azure Databricks | Microsoft Learn document, it's stated that Claude 3.7 and 4 Opus are " hosted by Databricks Inc. in AWS".  Is that accurate for Azure Databricks, or is there a...

  • 2847 Views
  • 1 replies
  • 0 kudos
Latest Reply
qlmahga2
New Contributor III
  • 0 kudos

Claude is not hosted on Azure. Only Amazon Bedrock and Google Cloud's Vertex AI. Databricks hosts it through AWS within their security perimeter; i.e., requests go through Amazon Bedrock (Fig. 1), as indicated by the model name in AWS format and the ...

  • 0 kudos
kingn718
by New Contributor III
  • 4542 Views
  • 6 replies
  • 1 kudos

Claude Opus not available in Databricks?

https://docs.databricks.com/aws/en/machine-learning/foundation-model-apis/supported-modelsOpus is listed here as available model, but I only see Sonnet 4 in Databricks? 

  • 4542 Views
  • 6 replies
  • 1 kudos
Latest Reply
Shua42
Databricks Employee
  • 1 kudos

Hi @kingn718 , Can you check to see if your workspace is in a supported region? Right now, Opus is only availble in us-east-1, us-east-2 and us-west-2 per https://docs.databricks.com/aws/en/machine-learning/model-serving/foundation-model-overview. If...

  • 1 kudos
5 More Replies