cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 33160 Views
  • 22 replies
  • 46 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 33160 Views
  • 22 replies
  • 46 kudos
Latest Reply
Darshan137
New Contributor II
  • 46 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 46 kudos
21 More Replies
SristiRaj
by New Contributor
  • 1555 Views
  • 2 replies
  • 0 kudos

Databricks REST api to manage and deploy Genie spaces programmatically

Hello,I am looking to find documentation for databricks REST api for creating and deploying genie spaces with necessary configuration. Could you please guide me to the documentation for the same.Regards,Sristi Raj 

  • 1555 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ale_Armillotta
Valued Contributor II
  • 0 kudos

Hi all. Justo to follow up this conversation. In these days I developed a simple notebook to deploy my genie space. This notebook is into a Job deployed with asset bundle. After the deployment into the target (dev/prod) the CI/CD run this pipeline to...

  • 0 kudos
1 More Replies
venkatved
by Databricks Partner
  • 308 Views
  • 1 replies
  • 1 kudos

Databricks App cannot authenticate to another Databricks App MCP server (OAuth consent redirect)

Hi Team,I am building an MCP client as a Databricks App that connects to an MCP server hosted on another Databricks App. The client works locally but fails when deployed due to OAuth consent redirect.Question: What is the recommended authentication a...

  • 308 Views
  • 1 replies
  • 1 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 1 kudos

TLDR: For Databricks App-to-App communication, you should use the client app's automatically provisioned Service Principal rather than On-Behalf-Of (OBO) user authentication to avoid interactive OAuth consent redirects.Why Your Local Approach Fails i...

  • 1 kudos
TX-Aggie-00
by Databricks Partner
  • 378 Views
  • 2 replies
  • 0 kudos

Resolved! ai_parse_document time out setting

We are using ai_parse_document on ~4k pdf files.  We noticed the load is taking quite a bit of time and when we looked into our intermediate table, we are seeing several errors like this:[ { "error_message":"pdf rendering timed out after 1800 s...

  • 378 Views
  • 2 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @TX-Aggie-00 ,  Thanks for the detailed description and for including the exact error message — that helps. The “pdf rendering timed out after 1800 seconds” message reflects an internal hard timeout during the document rendering step. The 1...

  • 0 kudos
1 More Replies
alessandrochamp
by New Contributor
  • 305 Views
  • 2 replies
  • 0 kudos

Endpoint not found

Azure Databricks workspace in East US 2.Genie works in UI but Conversation API returns ENDPOINT_NOT_FOUND.How can I enable Genie Conversation API?

  • 305 Views
  • 2 replies
  • 0 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 0 kudos

Hi @alessandrochamp, Can you double-check that the Genie API preview is enabled in your workspace? It is a Public Preview feature, and your error suggests that the preview might not be enabled. 

  • 0 kudos
1 More Replies
kdroz
by New Contributor
  • 598 Views
  • 1 replies
  • 1 kudos

Resolved! Genie spaces - instructions

Hi all,I'm experimenting with Databricks Genie, I have a setup where Genie is based on a Metrics View. In the Metrics View, we have multiple sales related measures and different kinds of revenue measures. Is anyone aware, if there is an option to add...

  • 598 Views
  • 1 replies
  • 1 kudos
Latest Reply
Sravani-Vadali
Databricks Employee
  • 1 kudos

Hello! Yes, this is possible! You can add this to the Instructions Section of your Genie Space. Here's an example: When users ask about "revenue" without specifying which type, always ask for clarification about which revenue measure they want: Total...

  • 1 kudos
Suheb
by Contributor
  • 458 Views
  • 1 replies
  • 0 kudos

Resolved! How do I get started with Databricks as a complete beginner?

How can a beginner start learning and using Databricks step by step?

  • 458 Views
  • 1 replies
  • 0 kudos
Latest Reply
joelramirezai
Databricks Employee
  • 0 kudos

You can use Databricks free edition to test Databricks and practice, even though the path will also depend in your goals as a professional. You can choose one or multiple of the following paths as guidance:  Platform, Data Engineering, Traditional ML...

  • 0 kudos
neeraj_borana
by Databricks Partner
  • 539 Views
  • 3 replies
  • 1 kudos

Resolved! AI Model to Generate Python Utilities

Hi team,I'm working on Databricks and need to choose a model from Foundation Model APIs / AI Playground to generate Python utilities for my infra team. For notebook Assistant (Ctrl+I in cells), which model would you recommend for reliable Python code...

  • 539 Views
  • 3 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hi, They are effectively the same assistant under the hood, it's more the context of where it's working from that's important.  So the cell based one will assume you're asking about the specific cell you're in and because it's only a small prompt win...

  • 1 kudos
2 More Replies
Jeff_Zhang
by New Contributor II
  • 520 Views
  • 4 replies
  • 2 kudos

[Genie] Format assistance & entity match doesn't work for me

I enable format assistance & entity match for some table fields in my genie space. But it looks like it doesn't work. e.g. the following field is categorical and I enable format assistance & entity match for it. The following is the generated sql: mo...

  • 520 Views
  • 4 replies
  • 2 kudos
Latest Reply
Jeff_Zhang
New Contributor II
  • 2 kudos

@pavannaidu I have tried all the approaches, but none of them works for me. Genie is a blackbox for me which means it is very hard for me to do the trouble shooting. 

  • 2 kudos
3 More Replies
harmankandhari
by New Contributor II
  • 407 Views
  • 2 replies
  • 2 kudos

Resolved! Harman Singh Deep Kandhari - Gym Owner Aspiring to Learn AI and Generative AI

Hi Everyone,My name is Harman Singh Deep Kandhari, a gym owner eager to learn Artificial Intelligence and Generative AI to enhance fitness services, automate operations, and create smarter, technology-driven workout experiences. Any suggestion from y...

  • 407 Views
  • 2 replies
  • 2 kudos
Latest Reply
harmankandhari
New Contributor II
  • 2 kudos

Thanks Anshu_Roy for your valuable reply. It would be helpful for me. Thanks!!Harmandeep Singh Kandhari

  • 2 kudos
1 More Replies
mmoise
by New Contributor II
  • 856 Views
  • 3 replies
  • 2 kudos

Resolved! Multi Agent Supervisor w/ Databricks App

Hello, how can I create a databricks app using multi agent supervisor (knowledge assistant + genie) with an interface?

  • 856 Views
  • 3 replies
  • 2 kudos
Latest Reply
pavannaidu
Databricks Employee
  • 2 kudos

@mmoise Multi Agent Supervisor (MAS) is an orchestrator agent, so it depends on: 1) how many agents it orchestrates, 2) how complex those agents are, and 3) how complex the user prompt is.  I would encourage you to review the MLflow experiment traces...

  • 2 kudos
2 More Replies
mimsalar
by New Contributor II
  • 633 Views
  • 2 replies
  • 4 kudos

Resolved! can I use AI/BI agents inside a databricks app?

is it possible to use the AI/BI agents that I built inside databricks to be called in a databrick app? so far, my finding shows the agent is an UI inside databricks and is not exposed as a rest API but i was wondering if anyone knows a solution to th...

  • 633 Views
  • 2 replies
  • 4 kudos
Latest Reply
emma_s
Databricks Employee
  • 4 kudos

By AI/BI agents do you mean Genie rooms? If so you can save these as a seperate Genie Room and then the Genie room will have an API endpoint that you can query from within the App. This is currently in public preview at the moment. The docs are here ...

  • 4 kudos
1 More Replies
Mathew
by New Contributor
  • 12743 Views
  • 1 replies
  • 0 kudos

How can I utilize multiple GPUs from multiple nodes in Databricks

I am currently experimenting with the whisper model for batchwise inference on Databricks and have successfully utilized multiple instances of the model by accessing multiple GPUs available in the driver node. However, I am wondering how I can levera...

  • 12743 Views
  • 1 replies
  • 0 kudos
Latest Reply
lin-yuan
Databricks Employee
  • 0 kudos

Can you try the Serverless GPU Compute? https://docs.databricks.com/aws/en/machine-learning/sgc-examples/gpu-batch-inference

  • 0 kudos
joaoaugustofb
by New Contributor
  • 232 Views
  • 1 replies
  • 1 kudos

Ai query parallel calls

I’m trying to optimize ai_query calls on a table and wanted to get some ideas.So far, I’ve tried repartitioning the DataFrame before running spark.sql(ai_query), but I didn’t see any meaningful performance gains. I also experimented with running mult...

  • 232 Views
  • 1 replies
  • 1 kudos
Latest Reply
pavannaidu
Databricks Employee
  • 1 kudos

When you are using ai_query(), there are two main aspects to performance:  Model serving endpointSQL warehouse / Compute cluster   Very likely, the performance is throttled by the model-serving endpoint's concurrency limit. Reference: https://docs.d...

  • 1 kudos
Rjdudley
by Honored Contributor
  • 1706 Views
  • 4 replies
  • 4 kudos

Resolved! Where are GPT-5 and Gemini in Azure Databricks?

Are GPT-5 and Gemini not available in Azure Databricks?  According to Native OpenAI Models Now Generally Available on Databricks | Databricks Blog and Google’s Gemini Models on Databricks | Databricks Blog these are both GA with no mention of platfor...

  • 1706 Views
  • 4 replies
  • 4 kudos
Latest Reply
Rjdudley
Honored Contributor
  • 4 kudos

An update: our account manager that the GPT models are available to accounts with a committed spend agreement, but not to the paygo customers.  We are a paygo customer, we have not reached the threshold of committed spend yet.  I think most of the sm...

  • 4 kudos
3 More Replies
shivamrai162
by New Contributor III
  • 430 Views
  • 1 replies
  • 2 kudos

Security considerations and model customization options for AgentBricks AI Agents and LLM Judges

Hello Databricks Team,We are currently evaluating AgentBricks AI Agents (for example, Knowledge Assistant and Multi-Agent Supervisor) and would like to better understand the security and model customization aspects.Data security & privacyWhat data (u...

Generative AI
Agent Bricks
  • 430 Views
  • 1 replies
  • 2 kudos
Latest Reply
pavannaidu
Databricks Employee
  • 2 kudos

@shivamrai162 1. Data security & privacy Agent Bricks uses default storage to store temporary data transformations, model checkpoints, and internal metadata that power each agent. On agent deletion, all data associated with the agent is removed from ...

  • 2 kudos