cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 39515 Views
  • 23 replies
  • 49 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 39515 Views
  • 23 replies
  • 49 kudos
Latest Reply
ChiranjeeviKudu
New Contributor
  • 49 kudos

Thanks for sharing.

  • 49 kudos
22 More Replies
ilaria
by Databricks Partner
  • 1328 Views
  • 1 replies
  • 0 kudos

Failed to fetch tables for the space when using Genie MCP via Model Serving

Hello everyone,I'm experiencing a specific permissions issue when using an AI agent that queries a Genie space via MCP (Model Context Protocol) within a Model Serving endpoint.I developed an AI agent to query a Genie space to retrieve retail sales da...

Generative AI
serving endpoints
Unity Catalog
  • 1328 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @ilaria, When you call a Genie space via MCP from a Model Serving endpoint, the queries against the table you have mentioned (fashion_retail.ppl_schema.silver_transactions) don’t run as you (the workspace user who owns the catalog/schema/space), b...

  • 0 kudos
Ale_Armillotta
by Valued Contributor II
  • 1797 Views
  • 1 replies
  • 1 kudos

Resolved! Voice Interface for Genie via Azure AI Foundry – 400 Bad Request with Cross-Subscription Setup

Hi everyone,I'm building a voice-enabled solution on Azure AI Foundry that allows users to interact with Genie using speech instead of text. The architecture involves exposing a Genie Space as a tool within Foundry, which works perfectly in my own en...

  • 1797 Views
  • 1 replies
  • 1 kudos
Latest Reply
Ale_Armillotta
Valued Contributor II
  • 1 kudos

I found the issues.the resources were deployed into different tenant and subscriptions. Seems now it's possible only to autentificate with PAT and not with other auth. So for now I can use only my account and not a Service Principal

  • 1 kudos
yarba2020
by New Contributor
  • 5193 Views
  • 2 replies
  • 3 kudos

Resolved! Modelling Genie AI/BI costs

I'm trying to model the full TCO of using Genie. We're thinking it would be 1,000 people using Genie, with 20 sessions per month (240 per year).From our understanding, Genie's costs are basically the DBUs that are consumed by running the SQL queries....

  • 5193 Views
  • 2 replies
  • 3 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 3 kudos

Total Cost ≈ (Avg queries per session × Avg query runtime × DBUs/sec × DBU price) + (Idle DBUs if non-serverless) + (Cloud infra, if applicable)

  • 3 kudos
1 More Replies
SristiRaj
by New Contributor
  • 2315 Views
  • 2 replies
  • 0 kudos

Databricks REST api to manage and deploy Genie spaces programmatically

Hello,I am looking to find documentation for databricks REST api for creating and deploying genie spaces with necessary configuration. Could you please guide me to the documentation for the same.Regards,Sristi Raj 

  • 2315 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ale_Armillotta
Valued Contributor II
  • 0 kudos

Hi all. Justo to follow up this conversation. In these days I developed a simple notebook to deploy my genie space. This notebook is into a Job deployed with asset bundle. After the deployment into the target (dev/prod) the CI/CD run this pipeline to...

  • 0 kudos
1 More Replies
venkatved
by Databricks Partner
  • 867 Views
  • 1 replies
  • 1 kudos

Databricks App cannot authenticate to another Databricks App MCP server (OAuth consent redirect)

Hi Team,I am building an MCP client as a Databricks App that connects to an MCP server hosted on another Databricks App. The client works locally but fails when deployed due to OAuth consent redirect.Question: What is the recommended authentication a...

  • 867 Views
  • 1 replies
  • 1 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 1 kudos

TLDR: For Databricks App-to-App communication, you should use the client app's automatically provisioned Service Principal rather than On-Behalf-Of (OBO) user authentication to avoid interactive OAuth consent redirects.Why Your Local Approach Fails i...

  • 1 kudos
TX-Aggie-00
by Databricks Partner
  • 1349 Views
  • 2 replies
  • 0 kudos

Resolved! ai_parse_document time out setting

We are using ai_parse_document on ~4k pdf files.  We noticed the load is taking quite a bit of time and when we looked into our intermediate table, we are seeing several errors like this:[ { "error_message":"pdf rendering timed out after 1800 s...

  • 1349 Views
  • 2 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @TX-Aggie-00 ,  Thanks for the detailed description and for including the exact error message — that helps. The “pdf rendering timed out after 1800 seconds” message reflects an internal hard timeout during the document rendering step. The 1...

  • 0 kudos
1 More Replies
alessandrochamp
by New Contributor
  • 791 Views
  • 2 replies
  • 0 kudos

Endpoint not found

Azure Databricks workspace in East US 2.Genie works in UI but Conversation API returns ENDPOINT_NOT_FOUND.How can I enable Genie Conversation API?

  • 791 Views
  • 2 replies
  • 0 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 0 kudos

Hi @alessandrochamp, Can you double-check that the Genie API preview is enabled in your workspace? It is a Public Preview feature, and your error suggests that the preview might not be enabled. 

  • 0 kudos
1 More Replies
kdroz
by New Contributor
  • 1584 Views
  • 1 replies
  • 1 kudos

Resolved! Genie spaces - instructions

Hi all,I'm experimenting with Databricks Genie, I have a setup where Genie is based on a Metrics View. In the Metrics View, we have multiple sales related measures and different kinds of revenue measures. Is anyone aware, if there is an option to add...

  • 1584 Views
  • 1 replies
  • 1 kudos
Latest Reply
Sravani-Vadali
Databricks Employee
  • 1 kudos

Hello! Yes, this is possible! You can add this to the Instructions Section of your Genie Space. Here's an example: When users ask about "revenue" without specifying which type, always ask for clarification about which revenue measure they want: Total...

  • 1 kudos
Suheb
by Contributor
  • 1303 Views
  • 1 replies
  • 0 kudos

Resolved! How do I get started with Databricks as a complete beginner?

How can a beginner start learning and using Databricks step by step?

  • 1303 Views
  • 1 replies
  • 0 kudos
Latest Reply
joelramirezai
Databricks Employee
  • 0 kudos

You can use Databricks free edition to test Databricks and practice, even though the path will also depend in your goals as a professional. You can choose one or multiple of the following paths as guidance:  Platform, Data Engineering, Traditional ML...

  • 0 kudos
neeraj_borana
by Databricks Partner
  • 1995 Views
  • 3 replies
  • 1 kudos

Resolved! AI Model to Generate Python Utilities

Hi team,I'm working on Databricks and need to choose a model from Foundation Model APIs / AI Playground to generate Python utilities for my infra team. For notebook Assistant (Ctrl+I in cells), which model would you recommend for reliable Python code...

  • 1995 Views
  • 3 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hi, They are effectively the same assistant under the hood, it's more the context of where it's working from that's important.  So the cell based one will assume you're asking about the specific cell you're in and because it's only a small prompt win...

  • 1 kudos
2 More Replies
harmankandhari
by New Contributor II
  • 1208 Views
  • 2 replies
  • 2 kudos

Resolved! Harman Singh Deep Kandhari - Gym Owner Aspiring to Learn AI and Generative AI

Hi Everyone,My name is Harman Singh Deep Kandhari, a gym owner eager to learn Artificial Intelligence and Generative AI to enhance fitness services, automate operations, and create smarter, technology-driven workout experiences. Any suggestion from y...

  • 1208 Views
  • 2 replies
  • 2 kudos
Latest Reply
harmankandhari
New Contributor II
  • 2 kudos

Thanks Anshu_Roy for your valuable reply. It would be helpful for me. Thanks!!Harmandeep Singh Kandhari

  • 2 kudos
1 More Replies
mmoise
by New Contributor II
  • 2764 Views
  • 3 replies
  • 2 kudos

Resolved! Multi Agent Supervisor w/ Databricks App

Hello, how can I create a databricks app using multi agent supervisor (knowledge assistant + genie) with an interface?

  • 2764 Views
  • 3 replies
  • 2 kudos
Latest Reply
pavannaidu
Databricks Employee
  • 2 kudos

@mmoise Multi Agent Supervisor (MAS) is an orchestrator agent, so it depends on: 1) how many agents it orchestrates, 2) how complex those agents are, and 3) how complex the user prompt is.  I would encourage you to review the MLflow experiment traces...

  • 2 kudos
2 More Replies
mimsalar
by New Contributor II
  • 1725 Views
  • 2 replies
  • 4 kudos

Resolved! can I use AI/BI agents inside a databricks app?

is it possible to use the AI/BI agents that I built inside databricks to be called in a databrick app? so far, my finding shows the agent is an UI inside databricks and is not exposed as a rest API but i was wondering if anyone knows a solution to th...

  • 1725 Views
  • 2 replies
  • 4 kudos
Latest Reply
emma_s
Databricks Employee
  • 4 kudos

By AI/BI agents do you mean Genie rooms? If so you can save these as a seperate Genie Room and then the Genie room will have an API endpoint that you can query from within the App. This is currently in public preview at the moment. The docs are here ...

  • 4 kudos
1 More Replies
Mathew
by New Contributor
  • 13143 Views
  • 1 replies
  • 0 kudos

How can I utilize multiple GPUs from multiple nodes in Databricks

I am currently experimenting with the whisper model for batchwise inference on Databricks and have successfully utilized multiple instances of the model by accessing multiple GPUs available in the driver node. However, I am wondering how I can levera...

  • 13143 Views
  • 1 replies
  • 0 kudos
Latest Reply
lin-yuan
Databricks Employee
  • 0 kudos

Can you try the Serverless GPU Compute? https://docs.databricks.com/aws/en/machine-learning/sgc-examples/gpu-batch-inference

  • 0 kudos
joaoaugustofb
by New Contributor
  • 665 Views
  • 1 replies
  • 1 kudos

Ai query parallel calls

I’m trying to optimize ai_query calls on a table and wanted to get some ideas.So far, I’ve tried repartitioning the DataFrame before running spark.sql(ai_query), but I didn’t see any meaningful performance gains. I also experimented with running mult...

  • 665 Views
  • 1 replies
  • 1 kudos
Latest Reply
pavannaidu
Databricks Employee
  • 1 kudos

When you are using ai_query(), there are two main aspects to performance:  Model serving endpointSQL warehouse / Compute cluster   Very likely, the performance is throttled by the model-serving endpoint's concurrency limit. Reference: https://docs.d...

  • 1 kudos
Labels