What's the challenge Build a Databricks App on Free Edition with a Genie Agent at its core. Build a Databricks App, create and configure your own Genie Agent, connect it to your App, and use it to power a meaningful, useful, or unexpected experienc...
- 1214 Views
- 3 replies
- 7 kudos
Monday
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, August 20, 2026! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data...
- 693 Views
- 2 replies
- 3 kudos
2 weeks ago
VIRTUAL TRAINING Time: AMER Aug 19 – Aug 20, 2026 | 9:00 AM PT / 12:00 PM ET Register for the Workshop Note: Marking RSVP on this Community event does not register you for the workshop. Please use the Register button above to complete your registr...
- 3007 Views
- 7 replies
- 6 kudos
a month ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 977 Views
- 0 replies
- 1 kudos
2 weeks ago
Congratulations to all members who have received the new Databricks Partner badge! Your badge recognizes your affiliation with the Databricks Partner ecosystem and helps community members quickly identify trusted partner professionals across discuss...
- 4578 Views
- 44 replies
- 10 kudos
3 weeks ago
New in Community Say hello to the Genie Hub Your questions about Databricks Genie, answered by the people actually building with it. Ask the community anything about Genie… Ask → Genie runs on plain-language conversation - you ask, it answers f...
- 1366 Views
- 1 replies
- 5 kudos
a month ago
Our Community Champion Program has always been about recognizing individuals who consistently show up to support others, share their expertise, and strengthen the Databricks Community. Alongside our customers, we’re equally proud to recognize the inc...
- 894 Views
- 4 replies
- 6 kudos
2 weeks ago
Manufacturers collect large volumes of sensor and equipment data, but measuring equipment productivity at the required latency and scale can be difficult with traditional systems. The Overall Equipment Effectiveness (OEE) Solution Accelerator demonst...
- 147 Views
- 0 replies
- 0 kudos
Tuesday
The Weekly Digest • August 10 – 16 Community Pulse Your weekly dose of the best articles, events, and conversations from the community. This Week's Community Stars The members who showed up and made a difference this week : @Sumit_7 @szymon_...
- 277 Views
- 1 replies
- 4 kudos
Tuesday
Community Activity
- 24 Views
- 0 replies
- 0 kudos
Databricks Connect + Serverless: Why "Module Not Found" Shows Up Only in CI, Not Interactively
A pattern that shows up repeatedly when people move a working Structured Streaming pipeline from "runs fine in a workspace notebook" to "runs in CI via Databricks Connect against serverless" is a ModuleNotFoundError that only appears in the second co...
- 24 Views
- 0 replies
- 0 kudos
- 514 Views
- 5 replies
- 4 kudos
DABs Migration Guide: Terraform to the Direct Deployment Engine
This guide covers the migration procedure and several behaviors worth knowing that this migration surfaced in practice. Background and timeline The deployment backend for DABs is moving from the Terraform engine to the new direct deployment engine. T...
- 514 Views
- 5 replies
- 4 kudos
Latest Reply
- 4 kudos
Thanks @-werners-, glad the guide helped. Your question is a bit outside what the blog covers. What you are seeing is a different thing: how the direct engine compares the values your cluster policy fills in each time you plan or deploy. It's a known...
- 4 kudos
- 222 Views
- 1 replies
- 0 kudos
Cross-engine Iceberg V3 compatibility issue- Databricks DELETE deletion vectors not readable by ext
Hi Databricks Support Team,We are raising this ticket to report a cross-engine compatibility issue between Databricks and Teradata when performing DELETE operations on an Iceberg V3 table.---ENVIRONMENT DETAILS-------------------Databricks Runtime V...
- 222 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @SRAVYA_TERADATA , nice writeup. The environment details and repro steps make this easy to follow. First, some context on what you're seeing. The Iceberg v3 spec defines a deletion vector as a deletion-vector-v1 blob stored in a Puffin file, and t...
- 0 kudos
- 269 Views
- 3 replies
- 0 kudos
Unexpected behavior of Delta VACUUM – need explanation
HelloI have a question about how VACUUM works.We executed the following VACUUM command from a PySpark job:spark.sql("""VACUUM catalog_name.schema_name.table_name RETAIN 168 HOURS""")The Delta table has a table property retention period of 365 days, b...
- 269 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Greetings @bricks_2026 , glad the first answer helped. Your sliding window observation is sharp, but one correction to the mental model: delta.deletedFileRetentionDuration only drives physical deletion at the moment a VACUUM executes. Between your w...
- 0 kudos
- 49 Views
- 1 replies
- 0 kudos
Power BI dashboards using Direct Lake
Hi Everyone, We are experimenting with using Direct Lake for our Power BI dashboards and I wanted to check in with this group to see if people have tried or are currently using this to connect PBI to Databricks tables. If so what is your experience w...
- 49 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
@dbernstein_tp Direct Lake is a Fabric feature designed to read Delta/Parquet files directly from One Lake storage. For standard Power BI to Databricks cases (Power BI reports directly from Databricks tables), you can use belowDirect Query on Datab...
- 0 kudos
- 172 Views
- 5 replies
- 0 kudos
Using autoloader with multiple object types in load path
My data source is going to generate csv files for multiple objects all into the same directory that I need to load from. The files will have names in the format along the lines of <objecttype>_YYYY_MM_DD_guid.csv.gz. Each objecttype will have it's ow...
- 172 Views
- 5 replies
- 0 kudos
Latest Reply
- 0 kudos
I’d avoid doing a dbutils.fs.ls followed by one Auto Loader stream per object type. That creates more streams/checkpoints as the number of object types grows.A cleaner pattern is to use one Auto Loader stream over the directory, extract objecttype fr...
- 0 kudos
- 808 Views
- 5 replies
- 0 kudos
Failed to save agent Supervisor Agent is not available. To access this feature, please contact sales
Hello,I am trying to create a Supervisor Agent via the web UI, and when starting to try and use it I get the errorFailed to save agent Supervisor Agent is not available. To access this feature, please contact salesThis is despite this preview being e...
- 808 Views
- 5 replies
- 0 kudos
Latest Reply
- 0 kudos
Well @appliable_ai then you might want to open a support ticket/contact your Databricks account team and ask them to enable/fix the Supervisor Agent entitlement on workspace. It works for me, but if I remember correctly I had to reach out to the our...
- 0 kudos
- 51 Views
- 0 replies
- 0 kudos
FAQ for Advanced Learning Festival September 16 - October 14 2026
Frequently Asked Questions Databricks Advanced Learning Festival | September 16 - October 14 2026 General Where can I ask questions while going through the self-paced material? The Databricks Academy Learners Group page is a forum within the Data...
- 51 Views
- 0 replies
- 0 kudos
- 82 Views
- 3 replies
- 2 kudos
Endpoint Error
I have a GCP Databricks account on the Enterprise plan with GCP Marketplace configured as the default payment method. Partner-powered AI features are enabled, and we enabled the Supervisor API Beta preview. Unity Catalog v3 model services are visible...
- 82 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
Hey, thanks for replying! I'm not really sure how to upgrade 'further' from what I can currently see under the 'Billing' section of my workplace, screenshot for the same is attached; your advice would be really helpful!
- 2 kudos
- 693 Views
- 2 replies
- 3 kudos
Upcoming Community BrickTalk: Mastering Databricks Genie Capabilities
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, August 20, 2026! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data...
- 693 Views
- 2 replies
- 3 kudos
Latest Reply
- 3 kudos
Hey Databricks Community!If anyone missed yesterday's awesome BrickTalk session, you can watch it here.
- 3 kudos
- 173 Views
- 1 replies
- 0 kudos
Issues with Custom Agents on Free Edition
I have ran into a few issues while learning how to use Custom Agents in Databricks Apps that I would like to call out - both to help others and hopefully motivate platform improvements.The only model that seems to work is databricks-meta-llama-3-3-70...
- 173 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
On the third issue (errors starting from the second user message) - this looks like it's coming from how the app's own conversation-history handling deals with items from the OpenAI Agents SDK's output, rather than from the model or MCP layer itself....
- 0 kudos
- 153 Views
- 1 replies
- 0 kudos
Resolved! Bedrock and Genie
Genie expertsWe are planning to utilize the AWS Bedrock agent to work with Genie One and invoke endpoints within Databricks. Our setup will involve multiple Databricks accounts that will be integrated with the Bedrock agent. I would appreciate any g...
- 153 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
A few practical patterns/gotchas that tend to matter for this kind of setup: 1. Bedrock doesn't have a native Genie connector, so the usual approach is to implement the call as a Bedrock Agent action group backed by a Lambda function. The Lambda wrap...
- 0 kudos
- 119 Views
- 1 replies
- 0 kudos
Databricks delta tables and Iceberg
Hi experts ,now databricks for support for Iceberg open table format conversion yet not fully though.Databricks calls this Delta Lake UniForm (Universal Format). When tentatively Databricks can support fully open table format Iceberg, Hudi etc.Is the...
- 119 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Worth separating "reading Iceberg from Delta" from "Databricks fully adopting Iceberg as a first-class table format" - those are two different things and Databricks has been moving on both fronts. Today: UniForm (Universal Format) makes a Delta table...
- 0 kudos
- 101 Views
- 1 replies
- 0 kudos
transformWithState might be causing 'Module not found'
Hi,So i've been playing around with transformWithState over the last few weeks and have got the code to work exactly as desired.Wrote some integration tests that execute fine within the workspace in serverless and everything, the issue is however is ...
- 101 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
This smells like a client/server module-resolution mismatch that's specific to Databricks Connect + serverless, rather than a wheel packaging problem per se. A few things worth checking: 1. Where the StatefulProcessor class lives. Since it's defined ...
- 0 kudos
- 1314 Views
- 5 replies
- 4 kudos
[Genie] Format assistance & entity match doesn't work for me
I enable format assistance & entity match for some table fields in my genie space. But it looks like it doesn't work. e.g. the following field is categorical and I enable format assistance & entity match for it. The following is the generated sql: mo...
- 1314 Views
- 5 replies
- 4 kudos
Latest Reply
- 4 kudos
@pavannaidu I would like to reopen this issue, as I have faced similar problems (and yes I made sure to enable it properly, toggling off and saving, toggling on and saving again, etc.). For Genie Agent in Chat Mode, when going into the thinking proce...
- 4 kudos
Announcements
| User | Count |
|---|---|
| 2289 | |
| 1359 | |
| 1251 | |
| 1184 | |
| 961 |
Latest from our Blog
Identity Columns Best Practices for Databricks Lakehouse
The surrogate key problem nobody plans for Sooner or later every data warehouse needs surrogate keys. You are building a dimension table and you want a single narrow column your fact tables can join o...
DABs Migration Guide: Terraform to the Direct Deployment Engine
This guide covers the migration procedure and several behaviors worth knowing that this migration surfaced in practice. Background and timeline The deployment backend for DABs is moving from the Terra...
Beyond Prompting: Production-Ready Image Generation and Visual Asset Management on Databricks
Image Generation in the Enterprise For agencies, creative studios, retailers, and media companies, visual assets are core to the business. Better image generation can directly improve output, speed, a...
LLMOps for Data Scientists and AI Builders: A Quickstart on Databricks
Building an LLM-powered prototype is easy. A few lines of code, a hosted model, and you have an agent that classifies tickets, summarizes documents, or answers questions. The hard part comes after: me...
