cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 36095 Views
  • 22 replies
  • 47 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 36095 Views
  • 22 replies
  • 47 kudos
Latest Reply
Darshan137
New Contributor II
  • 47 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 47 kudos
21 More Replies
Vamsi3757
by New Contributor
  • 616 Views
  • 2 replies
  • 0 kudos

Best Approach for Per-User Authentication with Databricks in an Agent-Based System

Hello everyone,I have built an ADK-based agent that connects to Databricks and can retrieve various information. However, I’m trying to design a secure way to authenticate each user individually when they interact with the agent.So far, I see two pos...

  • 616 Views
  • 2 replies
  • 0 kudos
Latest Reply
ShamenParis
New Contributor III
  • 0 kudos

Hello @Vamsi3757 , This is an excellent architecture question. You are completely right to avoid PATs (due to lifecycle/security risks) and Service Principals (which mask individual user identities and make Unity Catalog audit logging difficult).To s...

  • 0 kudos
1 More Replies
Bihaag_N
by New Contributor II
  • 904 Views
  • 3 replies
  • 2 kudos

Resolved! Genie UI MCP Server Connection Issue

Hi community,I ran into an issue while connecting a third-party MCP server to Genie's general chat UI and wanted to check if anyone else has seen this.The connection fails immediately during the initial MCP handshake with:`TypeError: unhashable type:...

  • 904 Views
  • 3 replies
  • 2 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 2 kudos

Hi @Bihaag_N, From what I can gather, I couldn't find this exact TypeError: unhashable type: 'list' in the public docs, and I also don’t see any documented connection-side requirement stating that third-party MCP manifests need list fields normalised...

  • 2 kudos
2 More Replies
michael365
by New Contributor III
  • 1344 Views
  • 2 replies
  • 1 kudos

Resolved! How does Genie look under the hood

Hi everybody,I'm using Genie for some time which is really great. In order to improve and before recommending it more users within our company I need to get more insights on Genie including but not limited to:Is it correct that the “thinking” part is...

  • 1344 Views
  • 2 replies
  • 1 kudos
Latest Reply
michael365
New Contributor III
  • 1 kudos

Hi @Ashwin_DSA thanks for your response.Regarding the performance issue the SQL is fast but the end-to-end response is still slow. So I assume that the bottleneck is Genie itself.I also resized the space in terms of number data sets added and improve...

  • 1 kudos
1 More Replies
Gautam2809
by New Contributor II
  • 846 Views
  • 3 replies
  • 1 kudos

Resolved! Can genie code be accessed via databricks app or external app; or is it confined to Workspace UI?

Hi, Can genie code be accessed via databricks app or external app; or is it confined to Workspace UI only?

  • 846 Views
  • 3 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

The question raised by @Gautam2809  was about Genie Code - specifically can you use it outside UI. And as of now there's no such an option.

  • 1 kudos
2 More Replies
lennonantonyy
by New Contributor
  • 453 Views
  • 1 replies
  • 1 kudos

Genie Code inline execution is very slow

Hi everyone,I’ve noticed that running inline code in Genie Code has been taking a long time, even for simple tasks.The only workaround I found so far was to explicitly instruct Genie to create notebooks in my personal folder and run the code there in...

  • 453 Views
  • 1 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @lennonantonyy, Thanks for raising this. Yes, I've seen similar reports from others as well. A few people have run into notebook slowness/browser memory pressure when Genie Code is open, including lag while typing and generally poorer performance ...

  • 1 kudos
Ale_Armillotta
by Valued Contributor II
  • 1057 Views
  • 2 replies
  • 0 kudos

Resolved! MLFlow tracking from Azure Container Instance

Hi everyone,we're building a voice chatbot for a customer using a mix of technologies — Databricks, Azure AI Foundry, and a few external containerized services.Currently, we're tracking requests and logs via Lakebase with custom traces, but I'm now e...

  • 1057 Views
  • 2 replies
  • 0 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 0 kudos

Similar response to the one from WorksBuddy.   Short answer: yes, it's supported, and there's a specific Databricks guide for your case.   The tutorial you found is for local/IDE; the production-container equivalent is here: Trace agents deployed out...

  • 0 kudos
1 More Replies
andr11v
by New Contributor
  • 306 Views
  • 1 replies
  • 0 kudos

Provisioned throughput is not enabled for this workspace

  I am seeing two related issues with Databricks-hosted Claude models in my workspace.Workspace details:- Cloud: AWS- Region: us-west-2- Tier: Premium PAYG- Serverless compute: enabled- Unity Catalog/metastore: configured- Compliance security profile...

andr11v_0-1779098540132.png andr11v_1-1779098542405.png andr11v_2-1779098546886.png
  • 306 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @andr11v, What you are seeing appears to be two separate issues rather than a single root cause. For the pay-per-token issue, the regional support table shows that Claude models are supported in AWS us-west-2, and the docs also say those models ar...

  • 0 kudos
michael365
by New Contributor III
  • 673 Views
  • 1 replies
  • 1 kudos

Resolved! Improving Genie Space via text instructions

Dear all,I'm trying to improve my Genie Space with some text instructions but very often Genie does not use it. If I prompt "Why have you not considered my instructions" after he answered a question he realizes that he forgot it. But this is too late...

  • 673 Views
  • 1 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @michael365, There is no documented hard rule that "general instructions must be 20 lines or less." Databricks guidance is to keep text instructions small, focused, and well-organised, because long or overly broad instructions can become less effe...

  • 1 kudos
lej6
by New Contributor II
  • 661 Views
  • 1 replies
  • 2 kudos

Resolved! Genie Space API – Inspect Mode Limitation

Hi everyone,Is Inspect mode supported when using the Genie Space API?If not, is there any plan to support it in the future?I notice a significant difference in answer quality when using Genie with Inspect mode enabled and disabled in th Databricks UI...

  • 661 Views
  • 1 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 2 kudos

Hi @lej6 ,For now inspection is not supported through Genie Space API. I guess it will be added in the future though. If my answer was helpful, please consider marking it as accepted solution.https://docs.databricks.com/aws/en/genie/conversation-api#...

  • 2 kudos
ashdc2026
by New Contributor II
  • 447 Views
  • 1 replies
  • 1 kudos

Resolved! Facing issue while opening Genie Code

Hi,For the past 3-4 days, I have not been able to open the Genie Code AI assistant in the Databricks workspace. Earlier, it was working fine and was quite helpful for code development.I am getting the error message shown below (screenshot pasted). I ...

ashdc2026_0-1779088955642.png
  • 447 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @ashdc2026 ,Check below thread. Try to also delete cookies. If that won't help use inspect tool and attach more detailed error message:Solved: Not able to access Databricks AI assistant or crea... - Databricks Community - 147951

  • 1 kudos
Ale_Armillotta
by Valued Contributor II
  • 621 Views
  • 1 replies
  • 2 kudos

Resolved! OAuth authentication is required for MCP servers hosted on Databricks Apps

Hi all.I'm deploying an agent with a custom MCP using Databrikcs.Unfortunately when I try to test the MCP connectivity I receive this error:OAuth authentication is required for MCP servers hosted on Databricks Apps. Your current authentication method...

  • 621 Views
  • 1 replies
  • 2 kudos
Latest Reply
Ale_Armillotta
Valued Contributor II
  • 2 kudos

I found the issue. I missed to create the OAuth token into Identity & user. I was using the SP secret. 

  • 2 kudos
cormierjohn
by New Contributor
  • 836 Views
  • 1 replies
  • 0 kudos

Resolved! FMAPI Anthropic endpoint rejects requests with trailing assistant message — known limitation?

Hey all — looking for confirmation on a behavior I'm hitting on the Foundation Model API (pay-per-token) Anthropic-compatible endpoint, in case anyone else has worked around it.What I'm doing: serving Claude models through /serving-endpoints/anthropi...

  • 836 Views
  • 1 replies
  • 0 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 0 kudos

Hi @cormierjohn , Your understanding is correct. The validation rejecting a trailing assistant turn is happening at the FMAPI proxy layer before the request reaches Claude, so any client that uses Anthropic's prefill primitive will 400 against this e...

  • 0 kudos
MWojcicki
by New Contributor
  • 417 Views
  • 1 replies
  • 0 kudos

Genie PDF export corrupts non-ASCII characters (Polish diacritics ł, ż, ś, ź, ę, ą)

When exporting a Genie conversation response to PDF, all Polish diacritical characters are systematically replaced with wrong ASCII characters, making the document unreadable for Polish-speaking users.Character substitution patternExpected Rendered a...

  • 417 Views
  • 1 replies
  • 0 kudos
Latest Reply
WiliamRosa
Databricks Partner
  • 0 kudos

Hi @MWojcicki My understanding is that Genie space skills would not solve this issue.The problem you described appears to be a **PDF rendering/export bug**, not something related to Genie instructions, skills, or table definitions.Based on your techn...

  • 0 kudos
prakashhinduja
by New Contributor III
  • 2152 Views
  • 6 replies
  • 1 kudos

Resolved! Prakash Hinduja Geneva, Switzerland, How do I fine-tune a large language model (LLM) in Databricks?

Hello Databricks Community,I am Prakash Hinduja from Geneva, Switzerland (Swiss), currently exploring fine-tuning large language models (LLMs) in Databricks and would appreciate any guidance or suggestions from those with experience in this area. Reg...

  • 2152 Views
  • 6 replies
  • 1 kudos
Latest Reply
anmolhhns
New Contributor III
  • 1 kudos

Hi @jayshan, you're right the material is outdated now. The more current path is Foundation Model Fine-tuning, which is part of Mosaic AI Model Training. You can run it from the Databricks UI or with the databricks_genai SDK, point it at training dat...

  • 1 kudos
5 More Replies
SaiVihAI
by New Contributor
  • 5007 Views
  • 2 replies
  • 0 kudos

Multi Vector Index

Can we create multi vector indexes on multiple embedding columns in delta table as part of databricks vector search

  • 5007 Views
  • 2 replies
  • 0 kudos
Latest Reply
jwaczak
New Contributor II
  • 0 kudos

Is this still the case? Both the rest api (https://docs.databricks.com/api/workspace/vectorsearchindexes/createindex) and the python sdk (https://databricks-sdk-py.readthedocs.io/en/latest/dbdataclasses/vectorsearch.html#databricks.sdk.service.vector...

  • 0 kudos
1 More Replies