cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by • Databricks Employee
  • 41447 Views
  • 23 replies
  • 51 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 41447 Views
  • 23 replies
  • 51 kudos
Latest Reply
ChiranjeeviKudu
New Contributor III
  • 51 kudos

Thanks for sharing.

  • 51 kudos
22 More Replies
FreshBrewedData
by • New Contributor II
  • 6180 Views
  • 5 replies
  • 3 kudos

Testing ai_parse_document vs PyMuPDF for PDF extraction

I’ve been experimenting with the Databricks AI functions and recently ran a small test extracting structured information from a PDF document.My initial approach was to use ai_parse_document to extract the text from the PDF.While the function appeared...

  • 6180 Views
  • 5 replies
  • 3 kudos
Latest Reply
LucasFazzi
New Contributor II
  • 3 kudos

Great points here! I'm using a similar hybrid approach in production:PyMuPDF runs on everything first, it extracts native text from digital PDFs (fast, free, zero AI cost). Any PDF that returns no text gets tagged as needs_ocr.Only the needs_ocr docu...

  • 3 kudos
4 More Replies
Brahmareddy
by • Esteemed Contributor II
  • 801 Views
  • 3 replies
  • 1 kudos

Building an Agentic HR Front Door on Databricks

I have been exploring one question for the last few months:What happens when enterprise AI moves from answering questions to actually completing tasks?That led me to build DwaraOne, an agentic HR front door using Databricks free edition.Most HR assis...

  • 801 Views
  • 3 replies
  • 1 kudos
Latest Reply
kartikchoudhary
Contributor
  • 1 kudos

Interesting to see the shift from AI assistants that answer questions to agents that can actually complete tasks. For enterprise adoption, I’m curious how teams are thinking about measuring business impact here — is the focus more on reducing manual ...

  • 1 kudos
2 More Replies
DoTA
by • Valued Contributor II
  • 2211 Views
  • 1 replies
  • 2 kudos

The Open-Weight Revolution: A Game Changer for Our LLM Cost Optimization Odyssey

How We Got HereWe started looking at the GLM-5.2 topic after Databricks released their benchmark comparing GLM-5.2 on PI against other models on other coding agents. What really attracted us was how far the gap has closed between open-weight models a...

  • 2211 Views
  • 1 replies
  • 2 kudos
Latest Reply
DoTA
Valued Contributor II
  • 2 kudos

Great analysis — this mirrors almost exactly what we've been studying in production at a regulated financial institution in Southeast Asia (banking sector).The "token price is a poor indicator of actual costs" point is the core insight most teams mis...

  • 2 kudos
Cobs
by • New Contributor
  • 542 Views
  • 1 replies
  • 0 kudos

How do I query genie space's actual conversation messages? (Genie space API)

 Hi I'm creating a databricks app and I want to show genie space conversations messages both from users and genie. This is the api i'm using : GET /api/2.0/genie/spaces/{space_id}/conversations/{conversation_id}/messages/{message_id}Get conversation ...

  • 542 Views
  • 1 replies
  • 0 kudos
Latest Reply
empire_labs
New Contributor II
  • 0 kudos

Hi Cobs, I hit the same wall building on the Genie API. The key is that content in the message object is the user's message, not Genie's answer. The actual response lives in the attachments array, and there are several attachment types:- attachments[...

  • 0 kudos
tensorwrangler
by • New Contributor II
  • 1470 Views
  • 6 replies
  • 0 kudos

Supervisor Agent or Knowledge assistant not available

I am unable to make use of the Supervisor Agent or Knowledge assistant.I have this issue on multiple Databricks environments / workspace (Databricks native / azure / ....)The databricks native one has a premium account with a credit card associated.T...

tensorwrangler_0-1785251706703.png
  • 1470 Views
  • 6 replies
  • 0 kudos
Latest Reply
emma_s
Databricks Employee
  • 0 kudos

Hi, Sorry you're still having issues but glad it seems to be working on the AWS one. It should be working in that region in Azure as far as I can tell. It could be an issue with model availability on Azure, at the point you tried it. If you have an A...

  • 0 kudos
5 More Replies
ajaygshah
by • Contributor
  • 1373 Views
  • 2 replies
  • 0 kudos

Resolved! Getting error in databricks agent response

I have selected a non-instruct model: databricks-qwen35-122b-a10b. Although the model doesn't matter. So when I type anything in the chat UI after deployment, the response is always along these lines:{ "detail": "1 validation error for ResponseOutp...

  • 1373 Views
  • 2 replies
  • 0 kudos
Latest Reply
ajaygshah
Contributor
  • 0 kudos

Hello! So I am using the built-in code when we initiate the databricks custom app using agent. After tweaking and using AI by Gemini and Claude, I was finally able to start the conversation and receive the response! Sharing the code below for anyone ...

  • 0 kudos
1 More Replies
r_w_
by • Databricks Partner
  • 703 Views
  • 1 replies
  • 0 kudos

Billing structure and LLM usage costs for no-code agents

I have some questions about the billing structure for no-code agents built with Agent Bricks and Genie Agent. I would appreciate your clarification.QuestionsOverview of where billing occurs When running a Supervisor Agent or Genie Agent created with ...

  • 703 Views
  • 1 replies
  • 0 kudos
Latest Reply
GabFernandes
Contributor III
  • 0 kudos

Hi @r_w_ !Estimating cost and understanding the billing model for No-Code Agents and Genie in Databricks comes down to how DBUs (Databricks Compute Units) and Token consumption are metered across three core layers:1. Overview of Where Billing OccursT...

  • 0 kudos
egs-zs8-1hamste
by • New Contributor
  • 426 Views
  • 1 replies
  • 0 kudos

Genie task running for over 20 hours.

 I have a Genie task running for over an hour and cannot cancel or quit. Is it safe to delete the notebook or its charrunning for over an hour and cannot cancel or quit. Is it safe to delete the notebook or its chart? 

egszs81hamste_1-1785407918147.png
  • 426 Views
  • 1 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 0 kudos

Hi egs,You can delete the notebook or chart to get rid of the hung Genie task. Since Genie tasks are generating and executing read only exploratory queries against the SQL Warehouse, they generally don't modify the underlying Delta tables. Deleting t...

  • 0 kudos
Niyojit
by • Databricks Partner
  • 2170 Views
  • 1 replies
  • 5 kudos

Resolved! How to get started with Genie Ontlogy?

Hello Databricks Community,I recently started exploring Genie Ontology and would like to implement it as part of a POC. However, I'm not sure how to get started.I have a few questions:What are the prerequisites for using Genie Ontology?How do I build...

  • 2170 Views
  • 1 replies
  • 5 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 5 kudos

Hi  ,What are the prerequisites for using Genie Ontology?Genie Ontology is under gated Public Preview. If you want to try it you need to contact with Databricks account teamHow do I build and configure an ontology from scratch?Rather than configuring...

  • 5 kudos
Brahmareddy
by • Esteemed Contributor II
  • 621 Views
  • 0 replies
  • 1 kudos

Omnigent: The Control Layer Enterprise AI Needs

Most companies are starting to use more AI agents.One team may use a coding agent. Another team may use a search agent. Some teams may build their own agents for specific business workflows. Each agent may work well on its own.The real problem starts...

  • 621 Views
  • 0 replies
  • 1 kudos
KarthikRK
by • New Contributor III
  • 2115 Views
  • 6 replies
  • 5 kudos

Resolved! Request to Enable Foundation Model Endpoint Rate Limits

Hi,I'm working on a trade surveillance agent and need access to foundation model endpoints.Currently getting this error when calling any LLM endpoint:Error: "The endpoint is temporarily disabled due to a Databricks-set rate limit of 0"Could you pleas...

Generative AI
workspace administration
  • 2115 Views
  • 6 replies
  • 5 kudos
Latest Reply
KarthikRK
New Contributor III
  • 5 kudos

@balajij8 -- qwen3-next-80b-a3b-instruct model has been very helpful for my POC/use case as it gives consistent and reproducible results. 

  • 5 kudos
5 More Replies
devyani_k
by • Databricks Partner
  • 590 Views
  • 1 replies
  • 1 kudos

'Schedules' feature in Genie One

I have created a schedule in the Genie One interface to share a report generated by Genie using my natural language questions. I receive the report on my outlook as expected.Is it possible to add other people to the schedule so that they receive the ...

devyani_k_0-1784851823727.png devyani_k_1-1784851871367.png
  • 590 Views
  • 1 replies
  • 1 kudos
Latest Reply
Brahmareddy
Esteemed Contributor II
  • 1 kudos

Hi DevyaniHow are you doing today? as per my knowledge, No, not today. A Genie One schedule belongs to whoever created it. The fields are only Title, Instructions, Connections, Schedule and Timezone, so there is no subscriber list, and the email goes...

  • 1 kudos
yassin
by • New Contributor
  • 844 Views
  • 1 replies
  • 0 kudos

Enable Foundation Model APIs for AWS Marketplace trial workspace

Hello,I created a new Databricks account through the AWS Marketplace $400 trial using my business email. The workspace is in us-east-1, the AWS Marketplace payment method is connected, and the full $400 credit balance is active.Every Databricks-hoste...

  • 844 Views
  • 1 replies
  • 0 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 0 kudos

That 403 with "rate limit of 0" isn't something you accidentally configured, it's a Databricks-imposed gate that applies to newly created accounts. Even with active trial credit and a valid payment method on file, Foundation Model API access gets hel...

  • 0 kudos
Bitrip007
by • New Contributor II
  • 804 Views
  • 1 replies
  • 0 kudos

New Agentic AI Ecosystem in Databricks

it seems Databricks is moving from traditional RAG pipelines toward agent-native architectures with Lakebase Search, Genie Agents, MCP integration, and semantic business context.For teams building enterprise GenAI applications today:Are you still bui...

  • 804 Views
  • 1 replies
  • 0 kudos
Latest Reply
DoTA
Valued Contributor II
  • 0 kudos

Given Databricks is now very mature in the Agentic/AI landscape comparing to 1 year ago, we are starting to leverage most of the capabilities from Databricks such as:1. Vector Search for Vector Database -> Transitioning to Lakebase Search.2. Lakebase...

  • 0 kudos
prasuanu1222
by • New Contributor II
  • 878 Views
  • 2 replies
  • 0 kudos

Short Term Memory & Long Term Memory

I am building an Agentic Application on Databricks using LangGraph (Classic Compute — Serverless cant be used so Agent Brickscant be used ).I want my agent to have two types of memory:Short-term memory â†’ Remember the current conversation and tool out...

  • 878 Views
  • 2 replies
  • 0 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 0 kudos

Use two layers: Short-term: LangGraph checkpointer for thread/session state.Long-term: for your case, prefer Databricks Managed Memory if available; otherwise use self-managed Lakebase. Managed memory is the simplest cross-session option and works wi...

  • 0 kudos
1 More Replies
Labels