cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 35175 Views
  • 22 replies
  • 47 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 35175 Views
  • 22 replies
  • 47 kudos
Latest Reply
Darshan137
New Contributor II
  • 47 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 47 kudos
21 More Replies
uhuru_furuta
by Databricks Partner
  • 1590 Views
  • 4 replies
  • 0 kudos

Resolved! Genie integration in Dashboards fails with "GenericChatCompletionServiceException" (Free Edition)

I am experiencing a persistent error when using Genie Space integration within a Databricks Dashboard (v3/Lakeview). While Genie works perfectly as a standalone Space, it consistently fails when invoked via the Dashboard sidebar.Environment:Edition: ...

  • 1590 Views
  • 4 replies
  • 0 kudos
Latest Reply
emma_s
Databricks Employee
  • 0 kudos

Yes 100%, any user would need to have select permissions on the table that the Genie Space is created on top of.

  • 0 kudos
3 More Replies
excavator-matt
by Contributor III
  • 9593 Views
  • 4 replies
  • 6 kudos

Managed MCP Server for Visual Studio Code and GitHub Copilot?

Hi!I am starting to explore the new managed Model Context Protocol (MCP) server with GitHub Copilot. I have successfully configured it to use the DBSQL MCP Server that you currently find in AI/ML -> Agents -> MCP Servers. As also shown in this post i...

Generative AI
copilot
MCP
OAuth
visual studio code
  • 9593 Views
  • 4 replies
  • 6 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 6 kudos

Hi excavator-matt, Thanks for the follow-up and glad to hear you got Option C (PAT-based) working with Copilot and VSCode, and that you have moved to Claude Code with the official skills. Regarding the issues with Options A and B: Option A (OAuth U2M...

  • 6 kudos
3 More Replies
Dale15PluCerts
by New Contributor II
  • 648 Views
  • 1 replies
  • 0 kudos

Ethical Data Governance

Title: Why Responsible AI Needs to Be a First‑Class Engineering Practice (Not an AfterthoughAI teams are moving faster than ever — but the industry is learning that speed without governance creates real downstream risk. Most “Responsible AI” failures...

  • 648 Views
  • 1 replies
  • 0 kudos
Latest Reply
Dale15PluCerts
New Contributor II
  • 0 kudos

Appreciate anyone who reads through this. I’m curious how teams are implementing governance controls in Databricks today — things like automated validation, model documentation, or lineage tracking through Unity Catalog. If you’ve built guardrails th...

  • 0 kudos
FreshBrewedData
by New Contributor II
  • 2447 Views
  • 4 replies
  • 3 kudos

Testing ai_parse_document vs PyMuPDF for PDF extraction

I’ve been experimenting with the Databricks AI functions and recently ran a small test extracting structured information from a PDF document.My initial approach was to use ai_parse_document to extract the text from the PDF.While the function appeared...

  • 2447 Views
  • 4 replies
  • 3 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 3 kudos

Great observations — this is a pattern several of us have run into. The short answer is: your PyMuPDF + ai_query workflow is the right approach for digitally-born PDFs, and here's why. Why aiparsedocument can get names/identifiers wrong ai_parse_docu...

  • 3 kudos
3 More Replies
JoaoPigozzo
by New Contributor III
  • 2003 Views
  • 1 replies
  • 1 kudos

Resolved! Claude Code User Usage Tracking

I am using Databricks Model Serving as a proxy to connect Claude Code. I established the connection through Integrate coding agents (Connect coding agents to Databricks) by generating the environment configuration:  { "env": { "ANTHROPIC_MODEL": "dat...

  • 2003 Views
  • 1 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @JoaoPigozzo, After some investigation, I found that when you use Databricks Model Serving as a proxy for Claude Code, what you see in system.billing.usage is expected. That table is is designed for cost attribution by SKU / endpoint, not per‑user...

  • 1 kudos
brahaman
by New Contributor II
  • 1813 Views
  • 2 replies
  • 0 kudos

Resolved! DatabricksVectorSearch seems to crash when served

Hey y'all !So I'm experimenting with the Databricks' DatanircksVectorSearch class in Python to serve as a tool that can be used by an agent. When I run it on a notebook, I get the following error:"[NOTICE] Using a notebook authentication token. Recom...

  • 1813 Views
  • 2 replies
  • 0 kudos
Latest Reply
ZD
New Contributor III
  • 0 kudos

@Louis_Frolio  Are there audit logs or visibility into which service principal is being used and what access it has?Another question: With automatic authentication passthrough, do we still need to set DATABRICKS_HOST and DATABRICKS_TOKEN as environme...

  • 0 kudos
1 More Replies
the_peterlandis
by New Contributor III
  • 913 Views
  • 1 replies
  • 1 kudos

Resolved! Databricks Apps Streaming issue

I have .NextJS Databricks Apps with streaming enabled by setting "stream:true" in the JSON body which tells serve to return a streaming response (SSE format).  Now this works just fine when I run the app locally via npm run dev but once I deploy the ...

  • 913 Views
  • 1 replies
  • 1 kudos
Latest Reply
the_peterlandis
New Contributor III
  • 1 kudos

What resolved this issue is to set the following headers listed below.  Content-Type: "text/event-stream"Connection: "keep-alive"Transfer-Encoding: "chunked"These headers help prevent proxy interference:Connection: "keep-alive" explicitly tells proxi...

  • 1 kudos
souravg
by New Contributor
  • 944 Views
  • 2 replies
  • 1 kudos

Resolved! Feedback not showing up in Genie from Copilot Studio Genie Agent

Hi,We've created an Agent using Copilot Studio for Genie and integrated with Teams Channel.The feedback there is working and we can see the reactions in the Copilot Studio Analytics.But the feedback is not going to the actual genie space, neither the...

  • 944 Views
  • 2 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @souravg, @Ale_Armillotta is right. At the moment, Genie only records feedback (thumbs up/down, "Fix it", comments) when it’s given directly in the Genie UI. The public Genie Conversation APIs that Copilot Studio/Teams use don’t expose any endpoin...

  • 1 kudos
1 More Replies
Jayachithra
by New Contributor II
  • 1195 Views
  • 1 replies
  • 1 kudos

Resolved! How to get MLflow OpenAI autolog traces from PySpark mapInPandas workers (and some pitfalls)

ContextI'm running an LLM pipeline on Databricks that distributes OpenAI API calls across Spark workers via mapInPandas. Getting mlflow.openai.autolog() to work on workers required solving three undocumented issues. Sharing here since I couldn't find...

  • 1195 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @Jayachithra , I did some digging and came up with some helpful tips/hints to help you along.   On Issue 1 (explicit MLflow context): expected behavior once you realize that mapInPandas spawns isolated Python worker processes, not threads. ...

  • 1 kudos
Louis_Frolio
by Databricks Employee
  • 3702 Views
  • 20 replies
  • 29 kudos

How Much Has AI Actually Changed Your Day to Day?

Community, I'm genuinely curious: Describe your workday two years ago vs. today in a sentence or two. I'll go first: then, I spent half my day context-switching between Drive, Sheets, Docs, and Slack just trying to find what I needed. Now, I vibe cod...

ai-productivity-before-after_1.jpg
  • 3702 Views
  • 20 replies
  • 29 kudos
Latest Reply
suranga
Databricks Partner
  • 29 kudos

What i think is AI hasn’t replaced the hard thinking, it has just removed a lot of the grunt work. These days I spend more time on judgment, review, and refinement, and less on searching, drafting, and repetitive setup.For Databricks specifically, th...

  • 29 kudos
19 More Replies
mimsalar
by New Contributor II
  • 497 Views
  • 2 replies
  • 0 kudos

Can I publish the query stored in the "Query History"?

I’m using an agent within a Databricks app that converts plain English into SQL, executes the query against a warehouse table, and returns the results.I’d like to know if there’s a way to also surface or publish the generated SQL query within the app...

  • 497 Views
  • 2 replies
  • 0 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 0 kudos

You may have to add a call to the Query History API with the necessary filter_by. https://docs.databricks.com/api/workspace/queryhistory/list

  • 0 kudos
1 More Replies
Ale_Armillotta
by Valued Contributor II
  • 2026 Views
  • 2 replies
  • 1 kudos

Resolved! How to deploy an Agent

Hi everyone, I’m currently developing several Databricks Agents using a custom Claude skill to integrate Databricks Asset Bundles (DABs), Mosaic AI frameworks, and LangGraph. My current workflow is the following: I develop the agents locally.For depl...

  • 2026 Views
  • 2 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hey, your approach is a common pattern. But there has been a recent shift where we now recommend creating the agents as databricks apps instead. This allows you to not do pipeline execution steps. Here are a couple of articles you may find helpful. h...

  • 1 kudos
1 More Replies
michael365
by New Contributor III
  • 1668 Views
  • 1 replies
  • 1 kudos

Resolved! Examples for Agent Skills @ Genie Code

Hi Community,I'm currently evaluating the potential of Agents Skills which can be configured for usage within Genie Code (formerly named Assistent).Does anybody know a source for examples what is possible with Agent Skills?The documentation does not ...

  • 1668 Views
  • 1 replies
  • 1 kudos
Latest Reply
pradeep_singh
Contributor III
  • 1 kudos

Here are bunch of skills example listed in databricks dev ai kit . You can build your own learning from these examples .https://github.com/databricks-solutions/ai-dev-kit/tree/main/databricks-skillsHere is how you can add these to make it available t...

  • 1 kudos
timbaron
by New Contributor II
  • 4088 Views
  • 11 replies
  • 0 kudos

Can't Access Agents

Hi there, I'm very new to Databricks and I wanted to try out Agents. At first, I thought I couldn't access Agents because I was on a Trial account, so I added my CC to the subscription. Unfortunately, I still can't access the feature, not to mention ...

timbaron_0-1768551967780.png
  • 4088 Views
  • 11 replies
  • 0 kudos
Latest Reply
BadrErraji
New Contributor III
  • 0 kudos

no support whatsoever

  • 0 kudos
10 More Replies
Sujitha
by Databricks Employee
  • 35175 Views
  • 22 replies
  • 47 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 35175 Views
  • 22 replies
  • 47 kudos
Latest Reply
Darshan137
New Contributor II
  • 47 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 47 kudos
21 More Replies