cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 34166 Views
  • 22 replies
  • 46 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 34166 Views
  • 22 replies
  • 46 kudos
Latest Reply
Darshan137
New Contributor II
  • 46 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 46 kudos
21 More Replies
smpa01
by Contributor
  • 11925 Views
  • 1 replies
  • 1 kudos

Resolved! ai_query issue

As per  the doc , one can execute an ai_query in python. But I am sot sure why I can'tWorks in SQLselect 1 as colA, ai_query('databricks-llama-4-maverick', 'what is 2+2') as testBut not in sparkdf = spark.sql("select 1 as colA") df = df.selectExpr(""...

  • 11925 Views
  • 1 replies
  • 1 kudos
Latest Reply
Vinay_M_R
Databricks Employee
  • 1 kudos

Hello @smpa01, I tried to reproduce this issue internally and it worked for me as expected in spark as well. I am sharing below screenshot for your reference: I used DBR 15.4 LTS and serverless it worked on both

  • 1 kudos
Remy
by New Contributor II
  • 1861 Views
  • 2 replies
  • 0 kudos

Questions about the Knowledge Assistant during agentBrick

hello.I'm testing agentBricks right now. As I'm testing, I have a few questions that I'd like to ask.1) Is it possible to input the schema in a format with input and output?2) In the free trial, when I create a vector search index and utilize it as a...

  • 1861 Views
  • 2 replies
  • 0 kudos
Latest Reply
Renu_
Valued Contributor II
  • 0 kudos

Hi @Remy, Yes, you can define input and output schemas in Databricks, typically using formats like Python dictionaries, especially when working with Vector Search indexes.Free Edition allows only one Vector Search endpoint per workspace, so creating ...

  • 0 kudos
1 More Replies
jcastro
by New Contributor
  • 7021 Views
  • 1 replies
  • 0 kudos

How to use `predict_stream` in Databricks deployed ChatAgent.

Hello,We are working on a solution to have a streaming chat agent. Our agent works fine in the Playground but when we try to call it as an api under /invocations, the streaming does not work. 

  • 7021 Views
  • 1 replies
  • 0 kudos
Latest Reply
Vinay_M_R
Databricks Employee
  • 0 kudos

Hello @jcastro I wish you a wonderful day ahead! Databricks recommends the MLflow ChatAgent interface to author production-grade agents. These ChatAgent provides advanced agent capabilities like Streaming output to enable interactive user experiences...

  • 0 kudos
MattB
by New Contributor III
  • 161757 Views
  • 12 replies
  • 11 kudos

AI/BI Genie - Call

HiIs there any way to call a Genie space from a notebook and get the response ? Is there any API available?#genie, #databricksgenie, #databricks_genie

  • 161757 Views
  • 12 replies
  • 11 kudos
Latest Reply
tomtillo
New Contributor II
  • 11 kudos

Here's the GEnie API Docs - currently in public preview. > Genie API | REST API reference | Databricks on AWSYou can connect to your Genie Spaces and interact with it programmatically.  

  • 11 kudos
11 More Replies
amitkumarvish
by Databricks Partner
  • 4813 Views
  • 1 replies
  • 1 kudos

Resolved! Delta Sync index - Slow Sync Performance from Delta Table to Mosaic AI Vector

I'm currently working with Mosaic AI Vector Search on Databricks and using a Delta Sync index (TRIGGERED) to sync from a Delta table (with embedding column already precomputed) to a vector index.However, I'm noticing the sync process is quite slow Ro...

  • 4813 Views
  • 1 replies
  • 1 kudos
Latest Reply
Vinay_M_R
Databricks Employee
  • 1 kudos

Hello @amitkumarvish , I wish you a wonderful day ahead! This could be due to dimension mismatch between precomputed embeddings and index expectations or due to storing unnecessary metadata columns or binary data in metadata fields which may creates ...

  • 1 kudos
hemeiling
by New Contributor
  • 899 Views
  • 1 replies
  • 0 kudos

How to build MLOps

How to use Databricks to build MLOps

  • 899 Views
  • 1 replies
  • 0 kudos
Latest Reply
Renu_
Valued Contributor II
  • 0 kudos

Hi @hemeiling, To build MLOps on Databricks, you can manage the full machine learning lifecycle in one unified platform. Start by preparing your data using Delta Lake and notebooks. Then, train and track models using MLflow, which lets you log metric...

  • 0 kudos
Rjdudley
by Honored Contributor
  • 3592 Views
  • 1 replies
  • 0 kudos

Resolved! Azure Databricks: Where are foundation models hosted

In the updated Supported models for Databricks Foundation Models APIs - Azure Databricks | Microsoft Learn document, it's stated that Claude 3.7 and 4 Opus are " hosted by Databricks Inc. in AWS".  Is that accurate for Azure Databricks, or is there a...

  • 3592 Views
  • 1 replies
  • 0 kudos
Latest Reply
qlmahga2
New Contributor III
  • 0 kudos

Claude is not hosted on Azure. Only Amazon Bedrock and Google Cloud's Vertex AI. Databricks hosts it through AWS within their security perimeter; i.e., requests go through Amazon Bedrock (Fig. 1), as indicated by the model name in AWS format and the ...

  • 0 kudos
kingn718
by New Contributor III
  • 5919 Views
  • 6 replies
  • 1 kudos

Claude Opus not available in Databricks?

https://docs.databricks.com/aws/en/machine-learning/foundation-model-apis/supported-modelsOpus is listed here as available model, but I only see Sonnet 4 in Databricks? 

  • 5919 Views
  • 6 replies
  • 1 kudos
Latest Reply
Shua42
Databricks Employee
  • 1 kudos

Hi @kingn718 , Can you check to see if your workspace is in a supported region? Right now, Opus is only availble in us-east-1, us-east-2 and us-west-2 per https://docs.databricks.com/aws/en/machine-learning/model-serving/foundation-model-overview. If...

  • 1 kudos
5 More Replies
SaiVihAI
by New Contributor
  • 4142 Views
  • 1 replies
  • 0 kudos

Multi-Vector Embedding Support

Does Databricks Vector Search support Multi-Vector Embedding?

  • 4142 Views
  • 1 replies
  • 0 kudos
Latest Reply
Vidhi_Khaitan
Databricks Employee
  • 0 kudos

I believe we can only have one embedding source column mapped to one embedding column.

  • 0 kudos
mark_goodwin
by New Contributor II
  • 1376 Views
  • 2 replies
  • 0 kudos

Error when querying RAG serving endpoint

I built a RAG by cloning the databricks example (create a vector search index of databricks documentation and then a RAG).When I try and call the RAG via the serving endpoint from a notebook, I get the following error:dictionary update sequence eleme...

  • 1376 Views
  • 2 replies
  • 0 kudos
Latest Reply
Shua42
Databricks Employee
  • 0 kudos

Hi @mark_goodwin , I believe this has to do with the formatting of the messages. In the serving UI, the formatting is abstracted out for you, but you may need to format it as a list of dictionaries for the invoke() call, such as: messages = [ {"r...

  • 0 kudos
1 More Replies
JoaoPigozzo
by New Contributor III
  • 5471 Views
  • 4 replies
  • 1 kudos

How to enable word_timestamps=True when querying a Whisper model deployed in Databricks?

I’ve deployed OpenAI’s Whisper model as a serving endpoint in Databricks and I’m trying to transcribe an audio file.import whisper model = whisper.load_model("small") transcript = model.transcribe( word_timestamps=True, audio="path/to/audio...

  • 5471 Views
  • 4 replies
  • 1 kudos
Latest Reply
lingareddy_Alva
Esteemed Contributor
  • 1 kudos

Hi @JoaoPigozzo To enable word_timestamps=True when querying your Whisper model deployed as a serving endpoint in Databricks,you must modify the serving endpoint’s inference logic to accept and process this parameter.1. Update your model serving func...

  • 1 kudos
3 More Replies
Nur07
by New Contributor
  • 1240 Views
  • 1 replies
  • 0 kudos

Resolved! AI for educators certificate

Recently I completed the Google generative A.I course for educators. At the start it was mentioned that I will receive a certificate but I didn't got any.. Please help me to get the certificate. 

  • 1240 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Community Manager
  • 0 kudos

Hello @Nur07! Congratulations on completing the course! Since the course isn’t affiliated with Databricks, I recommend contacting the platform or provider where you enrolled for assistance with the certificate. Let us know if you need help with Datab...

  • 0 kudos
JYvesLimantour
by New Contributor III
  • 2063 Views
  • 2 replies
  • 1 kudos

Resolved! Compound keys on Genie

Is it just me or Genie´s generated SQL code failes to use composite keys -of the underlying related tables- as its default behavoir, regardless of the model having relationships declared explicitly.Sometimes I have fixed this scenario by using an ins...

  • 2063 Views
  • 2 replies
  • 1 kudos
Latest Reply
SP_6721
Honored Contributor II
  • 1 kudos

Hi @JYvesLimantour Genie struggles with composite keys by design. A few things that might help:Clearly define your primary and foreign key relationships in Unity Catalog.Add example SQL queries that include composite joins to give Genie better contex...

  • 1 kudos
1 More Replies
brahaman
by New Contributor II
  • 1978 Views
  • 1 replies
  • 1 kudos

Question about response time by Llama 3.3 70B

Hey everyone !So I'm new into Databricks and I'm learning about the possibilities offered by Mosaic AI Foundation Model Serving. I'm mostly following the Azure's documentation to learn about it.In my testing, I've created 4 unity catalog functions vi...

  • 1978 Views
  • 1 replies
  • 1 kudos
Latest Reply
Walter_C
Databricks Employee
  • 1 kudos

Llama 3.3 normally offers faster inference speeds compared to earlier versions. It provides approximately 40% faster responses and reduced batch processing time However, the usual performance for Mosaic AI Model Serving are also influenced by configu...

  • 1 kudos