cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 38276 Views
  • 22 replies
  • 48 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 38276 Views
  • 22 replies
  • 48 kudos
Latest Reply
Darshan137
New Contributor II
  • 48 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 48 kudos
21 More Replies
Jayachithra
by New Contributor II
  • 1554 Views
  • 1 replies
  • 1 kudos

Resolved! How to get MLflow OpenAI autolog traces from PySpark mapInPandas workers (and some pitfalls)

ContextI'm running an LLM pipeline on Databricks that distributes OpenAI API calls across Spark workers via mapInPandas. Getting mlflow.openai.autolog() to work on workers required solving three undocumented issues. Sharing here since I couldn't find...

  • 1554 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @Jayachithra , I did some digging and came up with some helpful tips/hints to help you along.   On Issue 1 (explicit MLflow context): expected behavior once you realize that mapInPandas spawns isolated Python worker processes, not threads. ...

  • 1 kudos
Louis_Frolio
by Databricks Employee
  • 5507 Views
  • 20 replies
  • 29 kudos

How Much Has AI Actually Changed Your Day to Day?

Community, I'm genuinely curious: Describe your workday two years ago vs. today in a sentence or two. I'll go first: then, I spent half my day context-switching between Drive, Sheets, Docs, and Slack just trying to find what I needed. Now, I vibe cod...

ai-productivity-before-after_1.jpg
  • 5507 Views
  • 20 replies
  • 29 kudos
Latest Reply
suranga
Databricks Partner
  • 29 kudos

What i think is AI hasn’t replaced the hard thinking, it has just removed a lot of the grunt work. These days I spend more time on judgment, review, and refinement, and less on searching, drafting, and repetitive setup.For Databricks specifically, th...

  • 29 kudos
19 More Replies
mimsalar
by New Contributor II
  • 627 Views
  • 2 replies
  • 0 kudos

Can I publish the query stored in the "Query History"?

I’m using an agent within a Databricks app that converts plain English into SQL, executes the query against a warehouse table, and returns the results.I’d like to know if there’s a way to also surface or publish the generated SQL query within the app...

  • 627 Views
  • 2 replies
  • 0 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 0 kudos

You may have to add a call to the Query History API with the necessary filter_by. https://docs.databricks.com/api/workspace/queryhistory/list

  • 0 kudos
1 More Replies
Ale_Armillotta
by Valued Contributor II
  • 3154 Views
  • 2 replies
  • 1 kudos

Resolved! How to deploy an Agent

Hi everyone, I’m currently developing several Databricks Agents using a custom Claude skill to integrate Databricks Asset Bundles (DABs), Mosaic AI frameworks, and LangGraph. My current workflow is the following: I develop the agents locally.For depl...

  • 3154 Views
  • 2 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hey, your approach is a common pattern. But there has been a recent shift where we now recommend creating the agents as databricks apps instead. This allows you to not do pipeline execution steps. Here are a couple of articles you may find helpful. h...

  • 1 kudos
1 More Replies
michael365
by New Contributor III
  • 2423 Views
  • 1 replies
  • 1 kudos

Resolved! Examples for Agent Skills @ Genie Code

Hi Community,I'm currently evaluating the potential of Agents Skills which can be configured for usage within Genie Code (formerly named Assistent).Does anybody know a source for examples what is possible with Agent Skills?The documentation does not ...

  • 2423 Views
  • 1 replies
  • 1 kudos
Latest Reply
pradeep_singh
Honored Contributor III
  • 1 kudos

Here are bunch of skills example listed in databricks dev ai kit . You can build your own learning from these examples .https://github.com/databricks-solutions/ai-dev-kit/tree/main/databricks-skillsHere is how you can add these to make it available t...

  • 1 kudos
timbaron
by New Contributor II
  • 5910 Views
  • 11 replies
  • 0 kudos

Can't Access Agents

Hi there, I'm very new to Databricks and I wanted to try out Agents. At first, I thought I couldn't access Agents because I was on a Trial account, so I added my CC to the subscription. Unfortunately, I still can't access the feature, not to mention ...

timbaron_0-1768551967780.png
  • 5910 Views
  • 11 replies
  • 0 kudos
Latest Reply
BadrErraji
New Contributor III
  • 0 kudos

no support whatsoever

  • 0 kudos
10 More Replies
Sujitha
by Databricks Employee
  • 38276 Views
  • 22 replies
  • 48 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 38276 Views
  • 22 replies
  • 48 kudos
Latest Reply
Darshan137
New Contributor II
  • 48 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 48 kudos
21 More Replies
itssb
by New Contributor
  • 2419 Views
  • 1 replies
  • 1 kudos

Resolved! PERMISSION_DENIED: The endpoint is temporarily disabled due to a Databricks-set rate limit of 0

I'm new to databricks and been trying to test some AI models through the AI gateway, every model I try, it gives me error:"error_code":"PERMISSION_DENIED","message":"PERMISSION_DENIED: The endpoint is temporarily disabled due to a Databricks-set rate...

  • 2419 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @itssb , I did some digging and here is what I found: What you are seeing is a Databricks-imposed rate limit of 0, and that setting takes precedence over the endpoint- or user-level rate limits you configured in the UI. In other words, even...

  • 1 kudos
monke64
by New Contributor
  • 3361 Views
  • 3 replies
  • 0 kudos

Using generative AI to generate descriptions

Hi all, I would like to check if there is a function in databricks notebook that allows users to get AI generated descriptions of dataframes within the session similar to the AI generated descriptions for tables? This is because I am wondering it it ...

  • 3361 Views
  • 3 replies
  • 0 kudos
Latest Reply
michael365
New Contributor III
  • 0 kudos

You can also use Genie Code (which was named Assistent before) and put in some instructions as below. This would then be used and applied once the developer uses the Genie Code.Or alternatively you can create an Agent Skill and put those instructions...

  • 0 kudos
2 More Replies
michael365
by New Contributor III
  • 2971 Views
  • 3 replies
  • 1 kudos

Resolved! Sharing skills-extended Genie spaces with others

Hi all,I'm evaluating Genie and also developed some skills to extend Genie's capabilities.Now I would like to share it with others. Within the documentation it is stated "Skills live in the /Users/{username}/.assistant/skills/ directory. "Would skill...

  • 2971 Views
  • 3 replies
  • 1 kudos
Latest Reply
Ale_Armillotta
Valued Contributor II
  • 1 kudos

well, yes it has been renamed.So, regarding your question, seems:.assistant_instructions.md: it's a personal instruction and you cannot change this option.assistant_workspace_instructions.md: it's a workspace instruction applied to all the users. Onl...

  • 1 kudos
2 More Replies
nvkuriseti
by Databricks Partner
  • 1172 Views
  • 2 replies
  • 1 kudos

Resolved! Generative AI Engineering Pathway Demo Lab code

Hello, I am unable to find Lab code demo by Intructors during the GenAI Engineering Pathway. I have partner acadamy access and please let me know where I can find Demo Lab code for this pathway. Thanks for your reply or suggestion in advance.Thanks, ...

  • 1172 Views
  • 2 replies
  • 1 kudos
Latest Reply
nvkuriseti
Databricks Partner
  • 1 kudos

Hello @Ashwin_DSA , Thanks for your prompt reply. I will check with my Acadamy about Lab code and will let you know their reply. Thanks once again.Thanks, @nvkuriseti 

  • 1 kudos
1 More Replies
lewissolarin
by Databricks Partner
  • 1949 Views
  • 3 replies
  • 0 kudos

Databricks app calling Genie API has empty data array

I have a Databricks app that makes calls to Genie API, it successfully returns a response containing the text response and the generated SQL query. However, the actual result of the SQL query is missing, in the result object, there is the metadata fo...

  • 1949 Views
  • 3 replies
  • 0 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 0 kudos

Hi @lewissolarin,The behavior you are seeing, where data_array is None and external_links is empty, is expected at a certain stage of the Genie API workflow. The Genie API uses the EXTERNAL_LINKS disposition for returning query results, which means d...

  • 0 kudos
2 More Replies
rawalsparsh99
by New Contributor
  • 1420 Views
  • 3 replies
  • 0 kudos

Knowledge Assistant is disabled

These features are disabled i have completed all the prerequisites for this.I have the admin rights and have enabled all the required preview both at the account and the workspace level.also I have set serverless budget quota for the workspace as wel...

Screenshot 2026-01-28 180951.png
  • 1420 Views
  • 3 replies
  • 0 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 0 kudos

Hi @rawalsparsh99, Knowledge Assistant is part of the Agent Bricks feature set, and there are a few specific requirements that all need to be in place simultaneously for the feature tiles to become active. Since you mentioned you have admin rights, p...

  • 0 kudos
2 More Replies
jAAmes_bentley
by Databricks Partner
  • 2743 Views
  • 1 replies
  • 1 kudos

Resolved! Model Serving Endpoints Scaling From Zero Forever

Hello,When deploying agents via a Serving Endpoint with "Scale To Zero" enabled, we are encountering that at seemingly random times, when we hit the endpoint to wake it up, it will begin to "Scale From Zero", but will never become fully available. Th...

  • 2743 Views
  • 1 replies
  • 1 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 1 kudos

Hi @jAAmes_bentley, There are multiple possible root causes, so let me walk through them so you can diagnose which applies to your situation. WHAT HAPPENS DURING SCALE-FROM-ZERO When an endpoint scales from zero, Databricks must: 1. Acquire comp...

  • 1 kudos
ilaria
by Databricks Partner
  • 1177 Views
  • 1 replies
  • 0 kudos

Failed to fetch tables for the space when using Genie MCP via Model Serving

Hello everyone,I'm experiencing a specific permissions issue when using an AI agent that queries a Genie space via MCP (Model Context Protocol) within a Model Serving endpoint.I developed an AI agent to query a Genie space to retrieve retail sales da...

Generative AI
serving endpoints
Unity Catalog
  • 1177 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @ilaria, When you call a Genie space via MCP from a Model Serving endpoint, the queries against the table you have mentioned (fashion_retail.ppl_schema.silver_transactions) don’t run as you (the workspace user who owns the catalog/schema/space), b...

  • 0 kudos