cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 35845 Views
  • 22 replies
  • 47 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 35845 Views
  • 22 replies
  • 47 kudos
Latest Reply
Darshan137
New Contributor II
  • 47 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 47 kudos
21 More Replies
neeraj_borana
by Databricks Partner
  • 1452 Views
  • 3 replies
  • 1 kudos

Resolved! AI Model to Generate Python Utilities

Hi team,I'm working on Databricks and need to choose a model from Foundation Model APIs / AI Playground to generate Python utilities for my infra team. For notebook Assistant (Ctrl+I in cells), which model would you recommend for reliable Python code...

  • 1452 Views
  • 3 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hi, They are effectively the same assistant under the hood, it's more the context of where it's working from that's important.  So the cell based one will assume you're asking about the specific cell you're in and because it's only a small prompt win...

  • 1 kudos
2 More Replies
Jeff_Zhang
by New Contributor II
  • 977 Views
  • 4 replies
  • 2 kudos

[Genie] Format assistance & entity match doesn't work for me

I enable format assistance & entity match for some table fields in my genie space. But it looks like it doesn't work. e.g. the following field is categorical and I enable format assistance & entity match for it. The following is the generated sql: mo...

  • 977 Views
  • 4 replies
  • 2 kudos
Latest Reply
Jeff_Zhang
New Contributor II
  • 2 kudos

@pavannaidu I have tried all the approaches, but none of them works for me. Genie is a blackbox for me which means it is very hard for me to do the trouble shooting. 

  • 2 kudos
3 More Replies
harmankandhari
by New Contributor II
  • 783 Views
  • 2 replies
  • 2 kudos

Resolved! Harman Singh Deep Kandhari - Gym Owner Aspiring to Learn AI and Generative AI

Hi Everyone,My name is Harman Singh Deep Kandhari, a gym owner eager to learn Artificial Intelligence and Generative AI to enhance fitness services, automate operations, and create smarter, technology-driven workout experiences. Any suggestion from y...

  • 783 Views
  • 2 replies
  • 2 kudos
Latest Reply
harmankandhari
New Contributor II
  • 2 kudos

Thanks Anshu_Roy for your valuable reply. It would be helpful for me. Thanks!!Harmandeep Singh Kandhari

  • 2 kudos
1 More Replies
mmoise
by New Contributor II
  • 1892 Views
  • 3 replies
  • 2 kudos

Resolved! Multi Agent Supervisor w/ Databricks App

Hello, how can I create a databricks app using multi agent supervisor (knowledge assistant + genie) with an interface?

  • 1892 Views
  • 3 replies
  • 2 kudos
Latest Reply
pavannaidu
Databricks Employee
  • 2 kudos

@mmoise Multi Agent Supervisor (MAS) is an orchestrator agent, so it depends on: 1) how many agents it orchestrates, 2) how complex those agents are, and 3) how complex the user prompt is.  I would encourage you to review the MLflow experiment traces...

  • 2 kudos
2 More Replies
mimsalar
by New Contributor II
  • 1162 Views
  • 2 replies
  • 4 kudos

Resolved! can I use AI/BI agents inside a databricks app?

is it possible to use the AI/BI agents that I built inside databricks to be called in a databrick app? so far, my finding shows the agent is an UI inside databricks and is not exposed as a rest API but i was wondering if anyone knows a solution to th...

  • 1162 Views
  • 2 replies
  • 4 kudos
Latest Reply
emma_s
Databricks Employee
  • 4 kudos

By AI/BI agents do you mean Genie rooms? If so you can save these as a seperate Genie Room and then the Genie room will have an API endpoint that you can query from within the App. This is currently in public preview at the moment. The docs are here ...

  • 4 kudos
1 More Replies
Mathew
by New Contributor
  • 12974 Views
  • 1 replies
  • 0 kudos

How can I utilize multiple GPUs from multiple nodes in Databricks

I am currently experimenting with the whisper model for batchwise inference on Databricks and have successfully utilized multiple instances of the model by accessing multiple GPUs available in the driver node. However, I am wondering how I can levera...

  • 12974 Views
  • 1 replies
  • 0 kudos
Latest Reply
lin-yuan
Databricks Employee
  • 0 kudos

Can you try the Serverless GPU Compute? https://docs.databricks.com/aws/en/machine-learning/sgc-examples/gpu-batch-inference

  • 0 kudos
joaoaugustofb
by New Contributor
  • 452 Views
  • 1 replies
  • 1 kudos

Ai query parallel calls

I’m trying to optimize ai_query calls on a table and wanted to get some ideas.So far, I’ve tried repartitioning the DataFrame before running spark.sql(ai_query), but I didn’t see any meaningful performance gains. I also experimented with running mult...

  • 452 Views
  • 1 replies
  • 1 kudos
Latest Reply
pavannaidu
Databricks Employee
  • 1 kudos

When you are using ai_query(), there are two main aspects to performance:  Model serving endpointSQL warehouse / Compute cluster   Very likely, the performance is throttled by the model-serving endpoint's concurrency limit. Reference: https://docs.d...

  • 1 kudos
Rjdudley
by Honored Contributor
  • 2763 Views
  • 4 replies
  • 4 kudos

Resolved! Where are GPT-5 and Gemini in Azure Databricks?

Are GPT-5 and Gemini not available in Azure Databricks?  According to Native OpenAI Models Now Generally Available on Databricks | Databricks Blog and Google’s Gemini Models on Databricks | Databricks Blog these are both GA with no mention of platfor...

  • 2763 Views
  • 4 replies
  • 4 kudos
Latest Reply
Rjdudley
Honored Contributor
  • 4 kudos

An update: our account manager that the GPT models are available to accounts with a committed spend agreement, but not to the paygo customers.  We are a paygo customer, we have not reached the threshold of committed spend yet.  I think most of the sm...

  • 4 kudos
3 More Replies
shivamrai162
by New Contributor III
  • 777 Views
  • 1 replies
  • 2 kudos

Security considerations and model customization options for AgentBricks AI Agents and LLM Judges

Hello Databricks Team,We are currently evaluating AgentBricks AI Agents (for example, Knowledge Assistant and Multi-Agent Supervisor) and would like to better understand the security and model customization aspects.Data security & privacyWhat data (u...

Generative AI
Agent Bricks
  • 777 Views
  • 1 replies
  • 2 kudos
Latest Reply
pavannaidu
Databricks Employee
  • 2 kudos

@shivamrai162 1. Data security & privacy Agent Bricks uses default storage to store temporary data transformations, model checkpoints, and internal metadata that power each agent. On agent deletion, all data associated with the agent is removed from ...

  • 2 kudos
lucami
by Contributor
  • 1249 Views
  • 2 replies
  • 2 kudos

How to use CrewAI with Databricks-hosted LLMs (not OpenAI) ?

I am trying to use CrewAI to train an agent with a Databricks-hosted LLM (such as Llama 2 instruct or DBRX) via the databricks_langchain integration. I want CrewAI to use only my Databricks LLM and not requiring OpenAI authentication.However, when I ...

  • 1249 Views
  • 2 replies
  • 2 kudos
Latest Reply
pavannaidu
Databricks Employee
  • 2 kudos

@lucami  To configure CrewAI to use only Databricks-hosted models without OpenAI dependencies Use CrewAI's LLM class (which wraps litellm) rather than ChatDatabricks Pass the LLM at both levels: agents use it to complete their tasks, and the crew u...

  • 2 kudos
1 More Replies
excavator-matt
by Contributor III
  • 764 Views
  • 1 replies
  • 3 kudos

Resolved! What functions privileges are required to create/see Unity Catalog Function MCPs?

When you go AI/ML -> Agents - MCP Servers you can see the schema names with a server type UC Function for seemingly all schemas that contain Unity Catalog functions that you have created. However, when my colleague creates a function in a different s...

  • 764 Views
  • 1 replies
  • 3 kudos
Latest Reply
excavator-matt
Contributor III
  • 3 kudos

Now I see. My colleague didn't create a function, but a procedure. It is listed as a function in the MCP Servers view, but it is different in that it is a sequence of statements.

  • 3 kudos
Artur1
by Databricks Partner
  • 1327 Views
  • 3 replies
  • 2 kudos

Resolved! Clouds in Databricks

I'm trying to understand the differences between the clouds that offer Databricks, and I'm interested in GCP. However, I'm unsure if choosing GCP would allow me to use AI functionalities like Agent Bricks. Regardless of the cloud I choose, will I hav...

  • 1327 Views
  • 3 replies
  • 2 kudos
Latest Reply
pradeep_singh
Contributor III
  • 2 kudos

In my experience, Azure Databricks leads in rolling out new features, and GCP is generally the last.

  • 2 kudos
2 More Replies
anchalgarg0709
by New Contributor
  • 335 Views
  • 0 replies
  • 0 kudos

Where Data + Gen AI Adds Value in Modern Data Platforms

Data + Gen AI is most effective when grounded in real data constraints.On Databricks, combining Gen AI with Spark and Delta accelerates prototyping and testing, but fundamentals still matter—schema design, realistic distributions, and domain understa...

  • 335 Views
  • 0 replies
  • 0 kudos
actualhuman_012
by New Contributor III
  • 4269 Views
  • 5 replies
  • 2 kudos

Resolved! Documentation on all ways to access agent serving endpoint from outside databricks

Struggling to find clear documentation which can help me with the subject. Need to know all the ways (production best practices) along with API method. As far as I know, using PAT is not a production best practice

  • 4269 Views
  • 5 replies
  • 2 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 2 kudos

To access an Agent serving endpoint without a Personal Access Token (PAT), you must use OAuth 2.0 Machine-to-Machine (M2M) authentication. This is the industry-standard approach for production applications.1. OAuth M2M Authentication WorkflowInstead ...

  • 2 kudos
4 More Replies
tigerdeng
by New Contributor
  • 625 Views
  • 1 replies
  • 0 kudos
  • 625 Views
  • 1 replies
  • 0 kudos
Latest Reply
pradeep_singh
Contributor III
  • 0 kudos

For every endpoint there will be an inference table that can be configured to store the logs . https://docs.databricks.com/aws/en/ai-gateway/inference-tables#enable-and-disable-inference-tablesYou can then query and analyze this table - https://docs....

  • 0 kudos