cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by • Databricks Employee
  • 42384 Views
  • 24 replies
  • 51 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 42384 Views
  • 24 replies
  • 51 kudos
Latest Reply
ThiamLee
Contributor III
  • 51 kudos

Great initiative by Databricks! This is a valuable opportunity to build practical GenAI skills and stay ahead in the rapidly evolving AI space.

  • 51 kudos
23 More Replies
hhaaland
by • New Contributor
  • 277 Views
  • 1 replies
  • 0 kudos

Dashboards dual axis

Hi!I am using AI/BI dashboards with dual y-axis. If I have Axis Range set to Default, it is not very good at auto-scaling.  See attached example - notice the huge amount of dead spaceI could of course chose custom range to get better result, but then...

hhaaland_0-1794391222974.png
  • 277 Views
  • 1 replies
  • 0 kudos
Latest Reply
Valeria_Koz_DBX
Databricks Employee
  • 0 kudos

Hi @hhaaland, Current documentation on the AI/BI dashboards with dual y-axis states that axis range has three options: Default ("Use an automatic range")Per facet, which only applies to faceted chartsCustom ("Set fixed Minimum and Maximum values") Th...

  • 0 kudos
Valeria_Koz_DBX
by • Databricks Employee
  • 549 Views
  • 2 replies
  • 3 kudos

How to size your Genie bill (Genie Agent, Genie Code) before the free period ends (31 January 2027)

31 January 2027 is closer than it looks. Until then, every question your people ask Genie One or a Genie Agent is free. From 1 February, it's billed like the rest of Genie: a free monthly allowance per person, then pay-as-you-go. If nobody has worked...

  • 549 Views
  • 2 replies
  • 3 kudos
Latest Reply
Valeria_Koz_DBX
Databricks Employee
  • 3 kudos

Thanks @DoTA  this is exactly the kind of review a cost post needs, and all three points were right. I've updated the post:1. NULL price: step 4 no longer borrows a billed SKU. The step 3 query multiplies by your own price per DBU, so a free-only wor...

  • 3 kudos
1 More Replies
Chalapathi-Rao
by • Databricks MVP
  • 221 Views
  • 2 replies
  • 0 kudos

Seven checks before a Unity Gateway rollout

Dear Community Members,I’ve put together a practical guide to Databricks Unity Gateway, focusing on model access, MCP permissions, policy handling, and cost attribution.Here are seven checks I recommend before expanding a rollout:Verify that the inte...

runtime-architecture.png
  • 221 Views
  • 2 replies
  • 0 kudos
Latest Reply
DoTA
Honored Contributor
  • 0 kudos

Good list. On the denials question, I couldn't find anywhere in the docs that says how a policy block shows up in the usage table compared with an upstream failure, so I'd test it before trusting any alert. Send one request from an identity that's bl...

  • 0 kudos
1 More Replies
suranga
by • Databricks Partner
  • 623 Views
  • 6 replies
  • 6 kudos

Resolved! Do non-ASCII characters in file names break document indexing over a Unity Catalog volume?

I spent a few days on a document retrieval problem that turned out to have nothing to do with the retrieval setup, and I want to check whether anyone else has hit the same thing.Setup: around 40 internal PDF documents in a managed Unity Catalog volum...

  • 623 Views
  • 6 replies
  • 6 kudos
Latest Reply
suranga
Databricks Partner
  • 6 kudos

Update, as promised: it wasn't the file names.I had a support case open on this in parallel, and Databricks engineering has now looked into it. They reproduced å, ä, ö, spaces and accents in their own tests and everything retrieved correctly. They al...

  • 6 kudos
5 More Replies
gautamrjt
by • New Contributor
  • 275 Views
  • 1 replies
  • 0 kudos

403: Permission Denied for certain foundational models

Hello,I have an individual account (Azure Databricks, Premier, East US)without any support contracts, and I am using it solely for personal projects. I am getting this error whenever I am trying to use the GPT and/or Claude models (system.ai.claude-s...

  • 275 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @gautamrjt, I don't think this is a configuration issue on your side. Open models like Meta Llama 3.3 70B Instruct are available to pay-per-token workspaces by default. Premium partner models such as Anthropic Claude and the OpenAI GPT models have...

  • 0 kudos
krSindhu
by • New Contributor II
  • 572 Views
  • 3 replies
  • 0 kudos

Unable to Serve Gemini 3.8 Flash on Azure Databricks – East US

I am working with an Azure Databricks workspace in the East US region and am trying to use the Gemini 3.8 Flash model through Databricks Model Serving.The model is visible in the workspace under the system AI models as:system.ai.databricks-gemini-3-8...

error.png
  • 572 Views
  • 3 replies
  • 0 kudos
Latest Reply
AbhilashNagilla
Databricks Employee
  • 0 kudos

Hi @krSindhu, on Azure Databricks, Gemini 3.8 Flash needs both ADI Services, which require eligibility and enablement, and cross-geography routing. Check that the Integration with ADI Services toggle is enabled. Confirm that Enforce data processing...

  • 0 kudos
2 More Replies
data_pulse
by • Contributor
  • 289 Views
  • 2 replies
  • 0 kudos

ai_decide() failing with Endpoint is not enabled for batch inference in Free Edition

I'm running ai_decide() in a notebook (SQL cell, serverless compute) and it's now consistently failing with:[INTERNAL_ERROR] Remote session creation failed: INVALID_ARGUMENT: BAD_REQUEST: Endpoint ai_decide is not enabled for batch inference in this ...

  • 289 Views
  • 2 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor III
  • 0 kudos

The issue is tied to how Databricks Free Edition handles model serving resources. Specifically, the Free Edition imposes hard restrictions on these capabilities - there is no support for batch inference endpoints, no custom models and certain foundat...

  • 0 kudos
1 More Replies
ShivaPolusani
by • New Contributor II
  • 3668 Views
  • 3 replies
  • 0 kudos

Claude Desktop connect to Databricks MCP

How do I connect Claude desktop to Databricks connector (available in connectors)What are the steps involved in it,  Can any one provide detailed step by step implementation for this so that I can query the data using Claude desktop please?

  • 3668 Views
  • 3 replies
  • 0 kudos
Latest Reply
indradbxlearn
New Contributor III
  • 0 kudos

Hi @ShivaPolusani  - NOT sure whether you got your answer already or NOT....... but generally I followed the below steps for this activity - Path A: workspace with an account console (paid or trial)In the Databricks account console, go to Settings > ...

  • 0 kudos
2 More Replies
Vamsi3757
by • New Contributor III
  • 581 Views
  • 4 replies
  • 1 kudos

Best Architecture for Building a Custom Agent in Databricks?

Hi Everyone,I'm building a Databricks cost optimization agent and would appreciate some guidance on the recommended architecture.My current design consists of the following functions:Retrieve the last N job runs along with cost, DBU usage, runtime, c...

  • 581 Views
  • 4 replies
  • 1 kudos
Latest Reply
FrankAzzollini
New Contributor III
  • 1 kudos

Agent Framework for the agent, UC Functions for the reads, a Delta table for the event logsI'd go with a code-your-own agent in Agent Framework, but I'd move most of the heavy lifting out of the agent loop.1. Parse the Spark event logs in a scheduled...

  • 1 kudos
3 More Replies
DoTA
by • Honored Contributor
  • 546 Views
  • 3 replies
  • 0 kudos

Per-agent guardrails: what do you alert on, tokens, retries, or cost per task?

I'm trying to work out what a sensible guardrail looks like for each agent when several of them share a few serving endpoints.A plain token budget feels too blunt. An agent that retries a failing tool four times looks like a heavy user, while a cheap...

  • 546 Views
  • 3 replies
  • 0 kudos
Latest Reply
FrankAzzollini
New Contributor III
  • 0 kudos

Rate limits as a circuit breaker, loop alerts as the early warning, cost baseline for driftI'd use all three, but for different jobs, and I wouldn't make the token cap the main signal.1. Hard caps through AI Gateway. Keep them, but treat them as a ci...

  • 0 kudos
2 More Replies
sillytail_dev
by • New Contributor
  • 568 Views
  • 1 replies
  • 0 kudos

How to enable DeepSeek V4.1 Flash (1017) on a new AWS workspace?

Databricks Support referred me to the Community for help with account verification and model access.I have a newly created Databricks on AWS workspace. The account console shows Premium with AWS Marketplace billing configured. I authenticate using th...

  • 568 Views
  • 1 replies
  • 0 kudos
Latest Reply
Valeria_Koz_DBX
Databricks Employee
  • 0 kudos

Hi @sillytail_dev, Thanks for the detail. It makes this easier to pin down.To my knowledge, this shouldn't be a Unity Catalog permissions problem. You've already got EXECUTE on system.ai, and you're using the right model name for the Unity Gateway r...

  • 0 kudos
Sujitha
by • Databricks Employee
  • 42384 Views
  • 24 replies
  • 51 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 42384 Views
  • 24 replies
  • 51 kudos
Latest Reply
ThiamLee
Contributor III
  • 51 kudos

Great initiative by Databricks! This is a valuable opportunity to build practical GenAI skills and stay ahead in the rapidly evolving AI space.

  • 51 kudos
23 More Replies
Labels