cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by • Databricks Employee
  • 41239 Views
  • 23 replies
  • 51 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 41239 Views
  • 23 replies
  • 51 kudos
Latest Reply
ChiranjeeviKudu
New Contributor III
  • 51 kudos

Thanks for sharing.

  • 51 kudos
22 More Replies
Andrewww
by • New Contributor II
  • 1666 Views
  • 4 replies
  • 2 kudos

Genie space: Delta Tables or Metric View

I have started experimenting with Genie Spaces.I have a delta table with sales information. It has a date column, customer, product and amount bought.My question is, is it better to point the genie space to the raw table or create a metric view with ...

  • 1666 Views
  • 4 replies
  • 2 kudos
Latest Reply
gnakan
Databricks MVP
  • 2 kudos

Hey @Andrewww , I know your post was from a few months ago. But as I was testing out a use case, I came across your question and put together an experiment. Would love to hear where you ended up with your Genie agents.Experiment writeup is at https:/...

  • 2 kudos
3 More Replies
DoTA
by • Valued Contributor II
  • 266 Views
  • 2 replies
  • 1 kudos

How are you attributing agent cost per successful task, not just per token?

Hi everyone, I hope this helps start a useful comparison of notes for those running agents on Databricks in production.Token cost per endpoint is easy to get. Tag the serving endpoints, and the custom tags propagate to system.billing.usage, where usa...

  • 266 Views
  • 2 replies
  • 1 kudos
Latest Reply
SumeshKashyap
Contributor
  • 1 kudos

These are great questions. The third one in particular is where most setups I've seen get stuck, so thanks for starting this thread. Here's what tends to work, taking your questions one at a time.Q1: Are you computing cost per task from traces and to...

  • 1 kudos
1 More Replies
tarunnagar
by • Contributor
  • 232 Views
  • 1 replies
  • 0 kudos

What Are the Key Considerations for Building AI-Powered Applications?

Hi everyone,I’m exploring how teams are approaching AI-powered application development and would like to understand some practical considerations when moving from an AI prototype to a production application.For teams using Databricks, I’m particularl...

  • 232 Views
  • 1 replies
  • 0 kudos
Latest Reply
DoTA
Valued Contributor II
  • 0 kudos

Hi, some notes from running an internal agent platform on Databricks, in the order where they bit us hardest: 1. Evaluation before deployment is the one that gets skipped. Build a small labeled set (even 50 to 100 real questions with the answer and t...

  • 0 kudos
25Tabs
by • New Contributor II
  • 2150 Views
  • 5 replies
  • 2 kudos

Automate AI comment generation for columns

Hello, I have a question regarding the new AI Comment generation feature. Is it possbile to use this feature without using the UI. Currently i have to accept every suggested comment one-by-one. Is there a feature / SQL or Phython Statement that i can...

  • 2150 Views
  • 5 replies
  • 2 kudos
Latest Reply
juanlozadab
New Contributor III
  • 2 kudos

The ai_query route is the way to go, nothing to add there. Just a few thingsthat will bite you once you point it at a whole catalog.The big one is in the docs for the AI comments feature itself: saving a commentfires an ALTER, and that can disrupt ru...

  • 2 kudos
4 More Replies
haaland
by • Databricks Partner
  • 724 Views
  • 6 replies
  • 6 kudos

Resolved! Genie Agent SDK visualization

The documentation says you can send in an optional enable_visualization boolean when starting a conversation or sending a message to the agent:start_conversation_and_wait(space_id: str, content: str [, enable_visualization: Optional[bool], timeout: d...

  • 724 Views
  • 6 replies
  • 6 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 6 kudos

Hello @haaland, I took a look at both internal and external documentation and here is what I found. Glad it's working, and @Gecofer and @ivanvyd had the right diagnosis. enable_visualization was never removed. It shipped in databricks-sdk v0.120.0 (J...

  • 6 kudos
5 More Replies
Remon
by • New Contributor
  • 348 Views
  • 1 replies
  • 0 kudos

Gemini Foundation Model endpoint unavailable in 14-day commercial trial

Hi,I am using a 14-day Databricks commercial trial with promotional credits on an AWS Tokyo workspaceI am specifically trying to access the documented "databricks-gemini-3-8-flash" Foundation Model, but it is not available through Unity Gateway / Mod...

  • 348 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Hello @Remon , I took a look at both internal and external documentation and here is what I found. This looks like a model availability or routing issue, not a missing custom endpoint. Seeing databricks-gemini-3-8-flash under system.ai doesn't mean i...

  • 0 kudos
HOguns
by • New Contributor II
  • 2095 Views
  • 8 replies
  • 0 kudos

WORKSPACE HAS NO DAILY TOKEN ALLOWANCE

Hello Team,When I try to debug and troubleshoot this error: "This workspace has no daily token allowance for the assistant. Ask your workspace admin to enable it, then try again." I am the Admin, but I still don't see any way to resolve this issue, I...

  • 2095 Views
  • 8 replies
  • 0 kudos
Latest Reply
ErikVetter
New Contributor II
  • 0 kudos

Hey, I had a simillar problem, with the same Error Code.I asked Codex to fix it and the solution is very simple.In the Genie Code window, next to the send button, change from auto to low.I dont know, this seems like a bug since some weeks to me.

  • 0 kudos
7 More Replies
qduan
by • New Contributor II
  • 441 Views
  • 4 replies
  • 1 kudos

Knowledge Assistant fails to load after indexing; generated AI Search index cannot be reused

Hi Databricks Community,I created a Knowledge Assistant through Databricks → Agents, using files as the knowledge source. The embedding and indexing were handled automatically during setup.Since then, I have been unable to open the assistant. The UI ...

  • 441 Views
  • 4 replies
  • 1 kudos
Latest Reply
data_pulse
New Contributor III
  • 1 kudos

@qduan Also do check the backend state before re-creating the assistant. I had tested a similar failure path and saw the assistant remain in CREATING while the file source stayed in UPDATING, with no error_info surfaced yet.Few useful checks:import r...

  • 1 kudos
3 More Replies
GunaR
by • Contributor
  • 424 Views
  • 3 replies
  • 0 kudos

Genie Agent response Export to PDF via API

Hello,Got a need to invoke the Genie Agent chat (in agent mode) via API, and on the request completion, export the agent response in PDF and share the exported PDF in email.  Am already using 'Agent Mode Create Response' endpoint to invoke the chat p...

Generative AI
Genie Agent
  • 424 Views
  • 3 replies
  • 0 kudos
Latest Reply
GunaR
Contributor
  • 0 kudos

Thank you for the detailed analysis and input. I tried with List Conversations items endpoint, weasyprint for MD to HTML and on the agent request with Enable_viz:False. Here are my observations,1) Overall the output is not similar to export to excel....

  • 0 kudos
2 More Replies
Universeb
by • New Contributor II
  • 585 Views
  • 4 replies
  • 2 kudos

DeepSeek V4.1 Flash returns workspace ITPM rate-limit error on fresh/idle workspace

Hi, I am unable to use the Databricks-hosted DeepSeek V4.1 Flash model. Even a minimal prompt such as "hi" immediately fails with: REQUEST_LIMIT_EXCEEDED: Exceeded workspace input tokens per minute rate limit for databricks-deepseek-v4-1-flash. Pleas...

  • 585 Views
  • 4 replies
  • 2 kudos
Latest Reply
ivanvyd
New Contributor III
  • 2 kudos

@Universeb could you add your cloud, region and workspace tier, please? The published rate limits depend on the tier, so they don't establish your workspace's assigned quota.For one failed REST call, please include the UTC timestamp, any request ID, ...

  • 2 kudos
3 More Replies
Jeneive
by • New Contributor II
  • 289 Views
  • 2 replies
  • 0 kudos

Both Databricks Apps Returning 502 Bad Gateway

I am experiencing an issue with both of my Databricks Apps. Both applications are currently unavailable and are returning the same 502 Bad Gateway error.This is affecting both applications, so I would appreciate it if you could investigate whether th...

  • 289 Views
  • 2 replies
  • 0 kudos
Latest Reply
Jeneive
New Contributor II
  • 0 kudos

Thank you for the detailed guidance. The issue has been resolved, and both applications are now working fine.My assumption is that the issue was related to the application authentication check. The apps are now working independently without requiring...

  • 0 kudos
1 More Replies
haaland
by • Databricks Partner
  • 555 Views
  • 3 replies
  • 1 kudos

Resolved! Genie Agents citation (bug)

Agent reponses are showing this kind of plain text at the end of its text reponses: :citation[genie_sql.01f1b7e5-18d5-196a-90f2-2601ef936192]I think it is meant to be a clickable link. Will this be fixed soon?

  • 555 Views
  • 3 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @haaland - I believe the fix has now been rolled out, and I have tested my sandbox workspace where citations are working correctly. Please check and let me know if you still face issues. Happy to follow up internally.   

  • 1 kudos
2 More Replies
ram0021
by • New Contributor II
  • 1603 Views
  • 1 replies
  • 0 kudos

Not able to query serving endpoint thr UI consisting of logged pyfunc model calling DBRX endpoint

Hi All,I need some urgent help. I have created an serving endpoint through below code. The code logs in pyfunc model that internally calls DBRX endpoint. However when i query using below input i always get same error. Can someone please help me with ...

  • 1603 Views
  • 1 replies
  • 0 kudos
Latest Reply
DoTA
Valued Contributor II
  • 0 kudos

That traceback is actually coming from inside get_deploy_client("databricks").predict() itself, not from your own pyfunc code - it's failing on response.json() while parsing the HTTP response it got back from the endpoint you called. "Expecting value...

  • 0 kudos
suryaprayaga
by • Contributor
  • 363 Views
  • 2 replies
  • 2 kudos

Power of Genie

Folks, I must admit, at the beginning I was apprehensive of using Genie for almost anything. Now it solves almost anything that I want to code on Databricks. I was more fascinated with it when I learnt that our customer (who is one of the largest Tel...

  • 363 Views
  • 2 replies
  • 2 kudos
Latest Reply
ThomazNeto
Databricks Partner
  • 2 kudos

Surya, good to read this, and I get the initial hesitation. We had the same reaction on our side a year ago.What changed the picture for us wasn't Genie getting smarter on its own, it was what we put around it. Once we added clear instructions per sp...

  • 2 kudos
1 More Replies
juliopalmeiro
by • New Contributor II
  • 2687 Views
  • 2 replies
  • 1 kudos

Resolved! Foundation Models API blocked — "Databricks-set rate limit of 0" even after adding payment method

I'm trying to use the Foundation Models API (databricks-claude-opus-4-8) in my workspace but every call returns this error:PERMISSION_DENIED: The endpoint is temporarily disabled due to a Databricks-set rate limit of 0.This happens both from notebook...

  • 2687 Views
  • 2 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

Hi, this one isn't fixable from the endpoint or AI Gateway settings, even though it looks like a rate limit you should be able to just raise. That "Databricks-set rate limit of 0" is a workspace trust tier restriction, not the rate limit you configur...

  • 1 kudos
1 More Replies
Labels