cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 37129 Views
  • 22 replies
  • 48 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 37129 Views
  • 22 replies
  • 48 kudos
Latest Reply
Darshan137
New Contributor II
  • 48 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 48 kudos
21 More Replies
Ankitkalra40
by New Contributor II
  • 491 Views
  • 2 replies
  • 0 kudos

Resolved! Querying Metric Views via Classic/Pro SQL Warehouses

I recently came across a unique edge case where I was serving a few metric views to my Genie Space.Within metric views, I had custom formatting options such as currency in INR. When I was querying using a Serverless Warehouse, the results were correc...

  • 491 Views
  • 2 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor
  • 0 kudos

You can handle the localization directly in the SQL model using CONCAT('INR', FORMAT_NUMBER(revenue, 2)) if you must stay on Pro. Otherwise, as Databricks recommends Serverless for optimal Genie Space performance, move to a Serverless SQL warehouse a...

  • 0 kudos
1 More Replies
asfriz
by New Contributor II
  • 971 Views
  • 1 replies
  • 3 kudos

Request for Genie Agent Mode API with Streaming & Reasoning Trace Support

Hi everyone,Genie Agent Mode has been incredibly impressive and is one of the best tools we’ve come across, especially in how it handles multi-step reasoning and delivers structured end-to-end insights.We’re currently building a frontend application ...

  • 971 Views
  • 1 replies
  • 3 kudos
Latest Reply
Ankitkalra40
New Contributor II
  • 3 kudos

Hi Asfriz,Genie Agent mode is currently unavailable via direct API. This capability is something we are also eagerly waiting for.For now, you can try building an Agent Supervisor which has your Genie space served as a tool & utilize the orchestrator ...

  • 3 kudos
dkxxx-rc
by Contributor
  • 401 Views
  • 1 replies
  • 0 kudos

Resolved! Agent crashes out on cells with %skip?

On my first try with letting the Genie Code agent run multiple cells in my existing notebook, it fails at a certain cell that has previously been given the %skip magic.  If I un-skip it, agent can then run the cell.Bug?

  • 401 Views
  • 1 replies
  • 0 kudos
Latest Reply
emma_s
Databricks Employee
  • 0 kudos

Hi, this definitely sounds like a bug, the fact that when you remove the %skip it runs fine. I did also find another report of this issue. The best bet is to file a support ticket for this. They will make sure it gets to the correct engineering team....

  • 0 kudos
simmitil
by New Contributor
  • 1943 Views
  • 2 replies
  • 0 kudos

Resolved! Genie Agent Mode Visibility vs Standard Mode Monitoring

In standard Genie Space chat, space managers can use the Monitoring tab to review prompts/conversations. However, in Agent Mode, we see the warning:“Genie agent responses may contain results obtained using other users’ credentials and are hidden from...

  • 1943 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ksenia
New Contributor II
  • 0 kudos

If agent-mode Genie answers may contain data outside the reviewing manager’s own RLS/CLS scope, does that mean potentially sensitive data outside the Genie space (that is viewable to Genie Space user) is being processed by underlying foundation model...

  • 0 kudos
1 More Replies
Brahmareddy
by Esteemed Contributor II
  • 1436 Views
  • 1 replies
  • 0 kudos

The Real Problem with AI is Not Intelligence. It is Context.

I have been thinking a lot about something Ali Ghodsi (CEO - Databricks) said recently. In a Bloomberg interview, he stated: "We already have artificial general intelligence. We don't need AI to get smarter. It is just lacking context."After years of...

  • 1436 Views
  • 1 replies
  • 0 kudos
Latest Reply
Brahmareddy
Esteemed Contributor II
  • 0 kudos

 I built an interactive experience to go along with this discussion. It lets you toggle context signals on and off and see how AI decisions change in real time.Try it here: aineedscontext.comIt covers four scenarios: grocery reorder decisions, paymen...

  • 0 kudos
Clever
by New Contributor
  • 606 Views
  • 1 replies
  • 0 kudos

Resolved! Agent on Genie Code suddenly not available

Hello, I started using the agent mode in Genie Code these past 2 days, but a few hours ago it said "service is not available" and the agent button now disappeared. What happened?

  • 606 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @Clever, What you’re describing usually points to Genie Code Agent mode no longer being available in that workspace, rather than a problem with your specific chat session. A common reason is that partner-powered AI features may have been disabled ...

  • 0 kudos
arthurandrade
by New Contributor II
  • 1211 Views
  • 2 replies
  • 1 kudos

Resolved! MCPs not working properly

Has anyone facing the same issue?Basically we created a MCP to use OpenMetadata functionalities. It works fine on AI Playground, and it works fine on Databricks Genie (previously, Databricks One). But when I try to add this MCP on Genie Code, it fail...

  • 1211 Views
  • 2 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Hello @arthurandrade , I looked into this and here is what If found: These are really two separate problems, and the thing that untangles them is realizing that AI Playground, Chat in Genie (what used to sit under Databricks One), and Genie Code are ...

  • 1 kudos
1 More Replies
kumarsuresh
by New Contributor III
  • 11173 Views
  • 12 replies
  • 0 kudos

Gen AI course material

Databricks updated the Generative AI course https://partner-academy.databricks.com/learn/lp/315/generative-ai-engineering-pathway but the course material is missing in the partner academy. Does anybody know where to download the course material? 

  • 11173 Views
  • 12 replies
  • 0 kudos
Latest Reply
Neeljy
New Contributor II
  • 0 kudos

I wasn't able to find separate downloadable materials either. While searching for alternatives, I ended up using a few external GenAI courses (including one from Edureka) for additional practice and explanations. If anyone has located the official Da...

  • 0 kudos
11 More Replies
Brahmareddy
by Esteemed Contributor II
  • 2751 Views
  • 2 replies
  • 5 kudos

Databricks Genie Code One Month In — What It Means for Us as Data Engineers

As a data engineer, I've been watching Genie Code closely since it went GA last month, and I wanted to share some honest thoughts here today not a feature dump, but how it's starting to change the way I think about my own role.Databricks recently sha...

  • 2751 Views
  • 2 replies
  • 5 kudos
Latest Reply
sunmin_lee
Databricks Employee
  • 5 kudos

Very well said. Thanks for sharing your honest experiences! 

  • 5 kudos
1 More Replies
satusky
by New Contributor II
  • 1047 Views
  • 2 replies
  • 1 kudos

Resolved! Hosted gpt-oss endpoint system prompts contain "You have no access to tools"

We are using the foundation model endpoints (provisioned and pay-per-token) for the gpt-oss models for a research project. We have been experiencing consistent tool call failures: gpt-oss-20b was failing ~1 out of every 12, while gpt-oss-120b was fai...

  • 1047 Views
  • 2 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @satusky, I'm not an expert in this area, but after some internal research, I wouldn't treat a leaked system-prompt snippet as a product issue related to tool use. I can’t comment on the exact internal prompt template for a specific invocation, bu...

  • 1 kudos
1 More Replies
Vamsi3757
by New Contributor
  • 866 Views
  • 2 replies
  • 0 kudos

Best Approach for Per-User Authentication with Databricks in an Agent-Based System

Hello everyone,I have built an ADK-based agent that connects to Databricks and can retrieve various information. However, I’m trying to design a secure way to authenticate each user individually when they interact with the agent.So far, I see two pos...

  • 866 Views
  • 2 replies
  • 0 kudos
Latest Reply
ShamenParis
Contributor
  • 0 kudos

Hello @Vamsi3757 , This is an excellent architecture question. You are completely right to avoid PATs (due to lifecycle/security risks) and Service Principals (which mask individual user identities and make Unity Catalog audit logging difficult).To s...

  • 0 kudos
1 More Replies
Bihaag_N
by New Contributor II
  • 1105 Views
  • 3 replies
  • 2 kudos

Resolved! Genie UI MCP Server Connection Issue

Hi community,I ran into an issue while connecting a third-party MCP server to Genie's general chat UI and wanted to check if anyone else has seen this.The connection fails immediately during the initial MCP handshake with:`TypeError: unhashable type:...

  • 1105 Views
  • 3 replies
  • 2 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 2 kudos

Hi @Bihaag_N, From what I can gather, I couldn't find this exact TypeError: unhashable type: 'list' in the public docs, and I also don’t see any documented connection-side requirement stating that third-party MCP manifests need list fields normalised...

  • 2 kudos
2 More Replies
michael365
by New Contributor III
  • 2168 Views
  • 2 replies
  • 1 kudos

Resolved! How does Genie look under the hood

Hi everybody,I'm using Genie for some time which is really great. In order to improve and before recommending it more users within our company I need to get more insights on Genie including but not limited to:Is it correct that the “thinking” part is...

  • 2168 Views
  • 2 replies
  • 1 kudos
Latest Reply
michael365
New Contributor III
  • 1 kudos

Hi @Ashwin_DSA thanks for your response.Regarding the performance issue the SQL is fast but the end-to-end response is still slow. So I assume that the bottleneck is Genie itself.I also resized the space in terms of number data sets added and improve...

  • 1 kudos
1 More Replies
Gautam2809
by New Contributor II
  • 1036 Views
  • 3 replies
  • 1 kudos

Resolved! Can genie code be accessed via databricks app or external app; or is it confined to Workspace UI?

Hi, Can genie code be accessed via databricks app or external app; or is it confined to Workspace UI only?

  • 1036 Views
  • 3 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

The question raised by @Gautam2809  was about Genie Code - specifically can you use it outside UI. And as of now there's no such an option.

  • 1 kudos
2 More Replies
lennonantonyy
by New Contributor
  • 575 Views
  • 1 replies
  • 1 kudos

Genie Code inline execution is very slow

Hi everyone,I’ve noticed that running inline code in Genie Code has been taking a long time, even for simple tasks.The only workaround I found so far was to explicitly instruct Genie to create notebooks in my personal folder and run the code there in...

  • 575 Views
  • 1 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @lennonantonyy, Thanks for raising this. Yes, I've seen similar reports from others as well. A few people have run into notebook slowness/browser memory pressure when Genie Code is open, including lag while typing and generally poorer performance ...

  • 1 kudos