cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 39246 Views
  • 22 replies
  • 48 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 39246 Views
  • 22 replies
  • 48 kudos
Latest Reply
Darshan137
New Contributor II
  • 48 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 48 kudos
21 More Replies
Nur07
by New Contributor
  • 1455 Views
  • 1 replies
  • 0 kudos

Resolved! AI for educators certificate

Recently I completed the Google generative A.I course for educators. At the start it was mentioned that I will receive a certificate but I didn't got any.. Please help me to get the certificate. 

  • 1455 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Community Manager
  • 0 kudos

Hello @Nur07! Congratulations on completing the course! Since the course isn’t affiliated with Databricks, I recommend contacting the platform or provider where you enrolled for assistance with the certificate. Let us know if you need help with Datab...

  • 0 kudos
JYvesLimantour
by New Contributor III
  • 2466 Views
  • 2 replies
  • 1 kudos

Resolved! Compound keys on Genie

Is it just me or Genie´s generated SQL code failes to use composite keys -of the underlying related tables- as its default behavoir, regardless of the model having relationships declared explicitly.Sometimes I have fixed this scenario by using an ins...

  • 2466 Views
  • 2 replies
  • 1 kudos
Latest Reply
SP_6721
Honored Contributor II
  • 1 kudos

Hi @JYvesLimantour Genie struggles with composite keys by design. A few things that might help:Clearly define your primary and foreign key relationships in Unity Catalog.Add example SQL queries that include composite joins to give Genie better contex...

  • 1 kudos
1 More Replies
brahaman
by New Contributor II
  • 2315 Views
  • 1 replies
  • 1 kudos

Question about response time by Llama 3.3 70B

Hey everyone !So I'm new into Databricks and I'm learning about the possibilities offered by Mosaic AI Foundation Model Serving. I'm mostly following the Azure's documentation to learn about it.In my testing, I've created 4 unity catalog functions vi...

  • 2315 Views
  • 1 replies
  • 1 kudos
Latest Reply
Walter_C
Databricks Employee
  • 1 kudos

Llama 3.3 normally offers faster inference speeds compared to earlier versions. It provides approximately 40% faster responses and reduced batch processing time However, the usual performance for Mosaic AI Model Serving are also influenced by configu...

  • 1 kudos
Karthik_Karanm
by New Contributor III
  • 12216 Views
  • 10 replies
  • 7 kudos

Resolved! Insufficient Permission Error When Serving RAG Model with Multiple Vector Search Indexes

Hi Community,I’m currently working on a Retrieval-Augmented Generation (RAG) use case in Databricks. I’ve successfully implemented and served a model that uses a single Vector Search index, and everything works as expected.However, when I try to serv...

  • 12216 Views
  • 10 replies
  • 7 kudos
Latest Reply
lingareddy_Alva
Esteemed Contributor
  • 7 kudos

Thank you

  • 7 kudos
9 More Replies
skrishnaprasad
by New Contributor III
  • 3715 Views
  • 3 replies
  • 0 kudos

Vector Index format.

On of the key benefits of a delta table format is that it's open.  Is this also the case for vector indexes as well? If so where could I find it's specification?In Databricks today, we see that we can create and manage a vector index using API's. (ht...

  • 3715 Views
  • 3 replies
  • 0 kudos
Latest Reply
TejaJuttu
Databricks Partner
  • 0 kudos

HI Team, I am trying to update an existing vector search index with new data which is in another delta table. But i have no luck figuring out how to do it using Python SDK. Can you please hekp point to the right resources?

  • 0 kudos
2 More Replies
mayanksharma
by New Contributor
  • 5817 Views
  • 1 replies
  • 0 kudos

Is It Possible to use genie as tool in agents?

Hello, community,I am currently exploring the agentic workflow surrounding Genie and would like to know if there are ways to effectively integrate or incorporate Genie as a tool within my existing agentic workflow. I am open to utilizing frameworks s...

  • 5817 Views
  • 1 replies
  • 0 kudos
Latest Reply
kamal_ch
Databricks Employee
  • 0 kudos

You may find this useful for your use case - https://gist.github.com/prithvikannan/82e789730c2fceec11932816bda50e59

  • 0 kudos
Rumesh
by New Contributor
  • 3976 Views
  • 1 replies
  • 1 kudos

Resolved! AI/BI Genie Space - 20 QPM

Hi Databricks Community,I'm working with Genie Spaces and came across the documented limit of 20 questions per minute per workspace. Could someone please confirm whether this is a soft limit, and if it can be relaxed or increased upon request through...

  • 3976 Views
  • 1 replies
  • 1 kudos
Latest Reply
Advika
Community Manager
  • 1 kudos

Hello @Rumesh! The 20 questions per minute per workspace limit is fixed. To double-check for enterprise or production use cases, I recommend contacting your Account Executive or Databricks Support to confirm or explore possible options.

  • 1 kudos
kirti-11
by Databricks Partner
  • 5093 Views
  • 2 replies
  • 1 kudos

Databricks Serving Endpoint 400 Error: Model Response Format Issue while langgraph tool calling

Dear Databricks Community,I am seeking assistance with an issue I've encountered while deploying a model on Databricks. When invoking the serving endpoint, I receive the following error message sometimes:400 Client Error: Error: Model response did no...

  • 5093 Views
  • 2 replies
  • 1 kudos
Latest Reply
jericksoncea
New Contributor III
  • 1 kudos

Same issue here... developing a langraph tool-calling agent, and for certain (but not all) questions, I get the same error.Any luck resolving?

  • 1 kudos
1 More Replies
SomLTIM
by Databricks Partner
  • 990 Views
  • 1 replies
  • 0 kudos

Compute Claster Creation Failing

Everytime we try to roll out compute cluster it fails.

  • 990 Views
  • 1 replies
  • 0 kudos
Latest Reply
Shua42
Databricks Employee
  • 0 kudos

Hey @SomLTIM , Can you provide any additional information here to help troubleshoot? It would be helpful to know the region, cloud, error message, and any configurations you can provide on the cluster.

  • 0 kudos
RitikaKulshrest
by New Contributor
  • 3086 Views
  • 1 replies
  • 0 kudos

Unable to read message from Genie Conversation API

Hi Team,I am facing issue in getting the message details from the genie conversation API. I have created the conversation, which returns the message ID and conversation ID. But I am unable to see the message. I am getting error, when hitting the Get ...

  • 3086 Views
  • 1 replies
  • 0 kudos
Latest Reply
lingareddy_Alva
Esteemed Contributor
  • 0 kudos

@RitikaKulshrest I can see what's happening with your Genie conversation API issue. The problem is not with your API call but with the Genie service's attempt to execute your query.The response indicates that your message was received but failed to p...

  • 0 kudos
yj940525
by New Contributor III
  • 2484 Views
  • 3 replies
  • 0 kudos

Genie Agent integration issue

Hi, anyone from development team for Genie Agent integration?  i had an issue of using sample code of Genie Agent integration. The issue is that underlying code (databricks_ai_bridge/genie.py) cannot connect to url openaipublic.blob.core.windows.net ...

  • 2484 Views
  • 3 replies
  • 0 kudos
Latest Reply
lingareddy_Alva
Esteemed Contributor
  • 0 kudos

You're absolutely right. The implementation should definitely take restricted network scenarios into consideration, as many enterprise Databricks deployments operate in air-gapped or network-restricted environments.Commenting out the token counting l...

  • 0 kudos
2 More Replies
royinblr11
by Databricks Partner
  • 9430 Views
  • 2 replies
  • 2 kudos

Resolved! LLM with the largest context window

A Generative AI Engineer is tasked with developing an application that is based on an open-source large language model (LLM). They need a foundation LLM with a large context window. Which model fits this need?DBRX,Llama2-70B,DistilBert MPT-30B.DBRX h...

  • 9430 Views
  • 2 replies
  • 2 kudos
Latest Reply
lingareddy_Alva
Esteemed Contributor
  • 2 kudos

@royinblr11 You're absolutely right to question the answer — the correct model for an application needing a foundation LLM with a large context window is: DBRXWhy DBRX is the Best Fit:It is a foundation model, designed for generation tasks.It support...

  • 2 kudos
1 More Replies
brandt6264
by New Contributor II
  • 1725 Views
  • 3 replies
  • 0 kudos

Are serverless endpoints possible in this Technical Blog post by qianyu?

Hi, are serverless endpoints possible for Whisper and Llama in this Technical Blog post by qianyu?https://community.databricks.com/t5/technical-blog/streamline-customer-call-center-transcripts-analytics-with/ba-p/101689Thanks! 

  • 1725 Views
  • 3 replies
  • 0 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 0 kudos

https://www.databricks.com/product/pricing/foundation-model-servingWe don´t serve models on databricks, but as far as i can see you pay per input/output tokens (for foundation models).For classic models:https://www.databricks.com/product/pricing/mode...

  • 0 kudos
2 More Replies
pemidexx
by New Contributor III
  • 6007 Views
  • 4 replies
  • 2 kudos

Resolved! MLFlow Authentication from Databricks App for GenAI Tracing

I am working on a Dash-based app that includes a call to a Databricks-hosted LLM endpoint. I am trying to track those calls with MLFlow. My code is (roughly) like this:from openai import OpenAIimport mlflowmlflow.set_tracking_uri("databricks")mlflow....

  • 6007 Views
  • 4 replies
  • 2 kudos
Latest Reply
pemidexx
New Contributor III
  • 2 kudos

Thank you for the push in the right direction! I was able to solve the issue with this codeos.environ["DATABRICKS_CLIENT_ID"] = "" os.environ["DATABRICKS_CLIENT_SECRET"] = "" os.environ["DATABRICKS_TOKEN"] = os.environ.get("VAR_CONFIGURED_WITH_DATABR...

  • 2 kudos
3 More Replies
GabrielS
by New Contributor II
  • 11107 Views
  • 2 replies
  • 1 kudos

AI/BI Genie API

Hi everyone,I'm currently working on a project that implements a custom front end for Genie using the Genie API: https://docs.databricks.com/api/workspace/genie. So far, I’ve successfully built a working model that can send and receive messages.Howev...

  • 11107 Views
  • 2 replies
  • 1 kudos
Latest Reply
Walter_C
Databricks Employee
  • 1 kudos

Is there any possibility that workspace admin could have removed this permission to you? If you check the permissions on your side do you see yourself with at least Can View?

  • 1 kudos
1 More Replies
Labels