cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 39304 Views
  • 22 replies
  • 48 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 39304 Views
  • 22 replies
  • 48 kudos
Latest Reply
Darshan137
New Contributor II
  • 48 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 48 kudos
21 More Replies
IM_01
by Valued Contributor
  • 384 Views
  • 2 replies
  • 2 kudos

Databricks Knowledge Assistant

Hi All,I've been exploring Knowledge Assistant and trying to understand how it works under the hood. I noticed it's built on the Instructed Retriever architecture, and I recently came across an update called Instructed-Retriever-1, which is supposed ...

  • 384 Views
  • 2 replies
  • 2 kudos
Latest Reply
IM_01
Valued Contributor
  • 2 kudos

@suryaprayaga , I see the instructed-retriever-1 generates pair of query & filter, there can be filters that vector-index does not contain, what all metadata fields are persisted on vector-index , in case of llama-index we define the metadata columns...

  • 2 kudos
1 More Replies
FreshBrewedData
by New Contributor II
  • 4840 Views
  • 5 replies
  • 3 kudos

Testing ai_parse_document vs PyMuPDF for PDF extraction

I’ve been experimenting with the Databricks AI functions and recently ran a small test extracting structured information from a PDF document.My initial approach was to use ai_parse_document to extract the text from the PDF.While the function appeared...

  • 4840 Views
  • 5 replies
  • 3 kudos
Latest Reply
LucasFazzi
New Contributor II
  • 3 kudos

Great points here! I'm using a similar hybrid approach in production:PyMuPDF runs on everything first, it extracts native text from digital PDFs (fast, free, zero AI cost). Any PDF that returns no text gets tagged as needs_ocr.Only the needs_ocr docu...

  • 3 kudos
4 More Replies
Brahmareddy
by Esteemed Contributor II
  • 509 Views
  • 3 replies
  • 1 kudos

Building an Agentic HR Front Door on Databricks

I have been exploring one question for the last few months:What happens when enterprise AI moves from answering questions to actually completing tasks?That led me to build DwaraOne, an agentic HR front door using Databricks free edition.Most HR assis...

  • 509 Views
  • 3 replies
  • 1 kudos
Latest Reply
kartikchoudhary
New Contributor III
  • 1 kudos

Interesting to see the shift from AI assistants that answer questions to agents that can actually complete tasks. For enterprise adoption, I’m curious how teams are thinking about measuring business impact here — is the focus more on reducing manual ...

  • 1 kudos
2 More Replies
DoTA
by Valued Contributor
  • 1497 Views
  • 1 replies
  • 2 kudos

The Open-Weight Revolution: A Game Changer for Our LLM Cost Optimization Odyssey

How We Got HereWe started looking at the GLM-5.2 topic after Databricks released their benchmark comparing GLM-5.2 on PI against other models on other coding agents. What really attracted us was how far the gap has closed between open-weight models a...

  • 1497 Views
  • 1 replies
  • 2 kudos
Latest Reply
DoTA
Valued Contributor
  • 2 kudos

Great analysis — this mirrors almost exactly what we've been studying in production at a regulated financial institution in Southeast Asia (banking sector).The "token price is a poor indicator of actual costs" point is the core insight most teams mis...

  • 2 kudos
Cobs
by New Contributor
  • 373 Views
  • 1 replies
  • 0 kudos

How do I query genie space's actual conversation messages? (Genie space API)

 Hi I'm creating a databricks app and I want to show genie space conversations messages both from users and genie. This is the api i'm using : GET /api/2.0/genie/spaces/{space_id}/conversations/{conversation_id}/messages/{message_id}Get conversation ...

  • 373 Views
  • 1 replies
  • 0 kudos
Latest Reply
empire_labs
New Contributor II
  • 0 kudos

Hi Cobs, I hit the same wall building on the Genie API. The key is that content in the message object is the user's message, not Genie's answer. The actual response lives in the attachments array, and there are several attachment types:- attachments[...

  • 0 kudos
tensorwrangler
by New Contributor II
  • 893 Views
  • 6 replies
  • 0 kudos

Supervisor Agent or Knowledge assistant not available

I am unable to make use of the Supervisor Agent or Knowledge assistant.I have this issue on multiple Databricks environments / workspace (Databricks native / azure / ....)The databricks native one has a premium account with a credit card associated.T...

tensorwrangler_0-1785251706703.png
  • 893 Views
  • 6 replies
  • 0 kudos
Latest Reply
emma_s
Databricks Employee
  • 0 kudos

Hi, Sorry you're still having issues but glad it seems to be working on the AWS one. It should be working in that region in Azure as far as I can tell. It could be an issue with model availability on Azure, at the point you tried it. If you have an A...

  • 0 kudos
5 More Replies
ajaygshah
by New Contributor III
  • 857 Views
  • 2 replies
  • 0 kudos

Resolved! Getting error in databricks agent response

I have selected a non-instruct model: databricks-qwen35-122b-a10b. Although the model doesn't matter. So when I type anything in the chat UI after deployment, the response is always along these lines:{ "detail": "1 validation error for ResponseOutp...

  • 857 Views
  • 2 replies
  • 0 kudos
Latest Reply
ajaygshah
New Contributor III
  • 0 kudos

Hello! So I am using the built-in code when we initiate the databricks custom app using agent. After tweaking and using AI by Gemini and Claude, I was finally able to start the conversation and receive the response! Sharing the code below for anyone ...

  • 0 kudos
1 More Replies
r_w_
by Databricks Partner
  • 441 Views
  • 1 replies
  • 0 kudos

Billing structure and LLM usage costs for no-code agents

I have some questions about the billing structure for no-code agents built with Agent Bricks and Genie Agent. I would appreciate your clarification.QuestionsOverview of where billing occurs When running a Supervisor Agent or Genie Agent created with ...

  • 441 Views
  • 1 replies
  • 0 kudos
Latest Reply
GabFernandes
Contributor
  • 0 kudos

Hi @r_w_ !Estimating cost and understanding the billing model for No-Code Agents and Genie in Databricks comes down to how DBUs (Databricks Compute Units) and Token consumption are metered across three core layers:1. Overview of Where Billing OccursT...

  • 0 kudos
egs-zs8-1hamste
by New Contributor
  • 280 Views
  • 1 replies
  • 0 kudos

Genie task running for over 20 hours.

 I have a Genie task running for over an hour and cannot cancel or quit. Is it safe to delete the notebook or its charrunning for over an hour and cannot cancel or quit. Is it safe to delete the notebook or its chart? 

egszs81hamste_1-1785407918147.png
  • 280 Views
  • 1 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 0 kudos

Hi egs,You can delete the notebook or chart to get rid of the hung Genie task. Since Genie tasks are generating and executing read only exploratory queries against the SQL Warehouse, they generally don't modify the underlying Delta tables. Deleting t...

  • 0 kudos
Niyojit
by Databricks Partner
  • 719 Views
  • 1 replies
  • 5 kudos

Resolved! How to get started with Genie Ontlogy?

Hello Databricks Community,I recently started exploring Genie Ontology and would like to implement it as part of a POC. However, I'm not sure how to get started.I have a few questions:What are the prerequisites for using Genie Ontology?How do I build...

  • 719 Views
  • 1 replies
  • 5 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 5 kudos

Hi  ,What are the prerequisites for using Genie Ontology?Genie Ontology is under gated Public Preview. If you want to try it you need to contact with Databricks account teamHow do I build and configure an ontology from scratch?Rather than configuring...

  • 5 kudos
Brahmareddy
by Esteemed Contributor II
  • 478 Views
  • 0 replies
  • 1 kudos

Omnigent: The Control Layer Enterprise AI Needs

Most companies are starting to use more AI agents.One team may use a coding agent. Another team may use a search agent. Some teams may build their own agents for specific business workflows. Each agent may work well on its own.The real problem starts...

  • 478 Views
  • 0 replies
  • 1 kudos
KarthikRK
by New Contributor III
  • 1468 Views
  • 6 replies
  • 5 kudos

Resolved! Request to Enable Foundation Model Endpoint Rate Limits

Hi,I'm working on a trade surveillance agent and need access to foundation model endpoints.Currently getting this error when calling any LLM endpoint:Error: "The endpoint is temporarily disabled due to a Databricks-set rate limit of 0"Could you pleas...

Generative AI
workspace administration
  • 1468 Views
  • 6 replies
  • 5 kudos
Latest Reply
KarthikRK
New Contributor III
  • 5 kudos

@balajij8 -- qwen3-next-80b-a3b-instruct model has been very helpful for my POC/use case as it gives consistent and reproducible results. 

  • 5 kudos
5 More Replies
devyani_k
by Databricks Partner
  • 384 Views
  • 1 replies
  • 1 kudos

'Schedules' feature in Genie One

I have created a schedule in the Genie One interface to share a report generated by Genie using my natural language questions. I receive the report on my outlook as expected.Is it possible to add other people to the schedule so that they receive the ...

devyani_k_0-1784851823727.png devyani_k_1-1784851871367.png
  • 384 Views
  • 1 replies
  • 1 kudos
Latest Reply
Brahmareddy
Esteemed Contributor II
  • 1 kudos

Hi DevyaniHow are you doing today? as per my knowledge, No, not today. A Genie One schedule belongs to whoever created it. The fields are only Title, Instructions, Connections, Schedule and Timezone, so there is no subscriber list, and the email goes...

  • 1 kudos
yassin
by New Contributor
  • 518 Views
  • 1 replies
  • 0 kudos

Enable Foundation Model APIs for AWS Marketplace trial workspace

Hello,I created a new Databricks account through the AWS Marketplace $400 trial using my business email. The workspace is in us-east-1, the AWS Marketplace payment method is connected, and the full $400 credit balance is active.Every Databricks-hoste...

  • 518 Views
  • 1 replies
  • 0 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 0 kudos

That 403 with "rate limit of 0" isn't something you accidentally configured, it's a Databricks-imposed gate that applies to newly created accounts. Even with active trial credit and a valid payment method on file, Foundation Model API access gets hel...

  • 0 kudos
Bitrip007
by New Contributor II
  • 562 Views
  • 1 replies
  • 0 kudos

New Agentic AI Ecosystem in Databricks

it seems Databricks is moving from traditional RAG pipelines toward agent-native architectures with Lakebase Search, Genie Agents, MCP integration, and semantic business context.For teams building enterprise GenAI applications today:Are you still bui...

  • 562 Views
  • 1 replies
  • 0 kudos
Latest Reply
DoTA
Valued Contributor
  • 0 kudos

Given Databricks is now very mature in the Agentic/AI landscape comparing to 1 year ago, we are starting to leverage most of the capabilities from Databricks such as:1. Vector Search for Vector Database -> Transitioning to Lakebase Search.2. Lakebase...

  • 0 kudos
Labels