NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...
- 1744 Views
- 1 replies
- 1 kudos
2 weeks ago
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 1313 Views
- 0 replies
- 2 kudos
2 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 3957 Views
- 0 replies
- 4 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 1051 Views
- 0 replies
- 1 kudos
2 weeks ago
Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...
- 663 Views
- 1 replies
- 5 kudos
2 weeks ago
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 851 Views
- 0 replies
- 4 kudos
3 weeks ago
Community Activity
- 27 Views
- 1 replies
- 0 kudos
Unable to user serverless GPU
I am currently using a premium plan, it was set up as a managed databricks account (no attached cloud account). I do have a credit card attached to the account, so it does not say "free trial". When I try to use a serverless GPU, I get the error "An ...
- 27 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @ryanforsythe8 have alook at this thread : https://community.databricks.com/t5/machine-learning/can-t-select-serverless-gpu-on-notebooks/m-p/162334#M4648
- 0 kudos
- 8 Views
- 0 replies
- 0 kudos
Databricks Exclusive Access
I’m exploring how to set up exclusive access for separate use cases implementation within a shared Databricks workspace, using Microsoft Entra groups and Unity Catalog. I’d love to hear from anyone who has implemented something similar, or is current...
- 8 Views
- 0 replies
- 0 kudos
- 201 Views
- 4 replies
- 0 kudos
Data Ingestion Lakeflow UI Bug - Does not allow to create streaming table with BINARY data type
Data Ingestion (Lakeflow) Feature Bug:While creating Data Ingestion streaming table for ingesting pdf files, so that it can store into Binary format, it doesn't allow to select for BINARY data type for a column like (content), but it chose default da...
- 201 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @kapil_dua This works for me so what are you doing differently?
- 0 kudos
- 83 Views
- 2 replies
- 1 kudos
Unable to Attach Databricks Serverless Compute – Environment Version 5 (Heavy Load Warning)
Hi Databricks Community,I'm experiencing an issue with Databricks Serverless Compute while trying to attach it to my notebook using Serverless Environment Version 5.Whenever I attempt to attach the compute, I receive the following warning: "Databrick...
- 83 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hello @NaniOnyx07, I took a look at both internal and external documentation and here is what I found. First, credit to @ThomazNeto for the thorough first pass. I checked his facts against the docs and he is spot on: environment version 5 shipped in ...
- 1 kudos
- 303825 Views
- 5 replies
- 10 kudos
The Ultimate Guide to Chunking Strategies for RAG Applications with Databricks
Over the years, I have collaborated closely with ML engineering leaders across various industries, guiding them on how to make the right chunking strategy decisions for their Retrieval-Augmented Generation (RAG) use cases. One of the biggest challeng...
- 303825 Views
- 5 replies
- 10 kudos
- 380 Views
- 4 replies
- 3 kudos
Unity Catalog external location access error after metastore attachment
Hi everyone,I am running into a permission issue when trying to query data from an external S3 storage location managed through Unity Catalog.Here are the symptoms:The Setup: Storage credentials and an external location were successfully created, and...
- 380 Views
- 4 replies
- 3 kudos
Latest Reply
- 3 kudos
Hello @Khasim_1, I took a look at both internal and external documentation and here is what I found. First, credit to @data_pulse, @pradeep_singh and @saurabh18cs, who've already laid out the standard triage. Capture the exact error. Confirm the job'...
- 3 kudos
- 287 Views
- 7 replies
- 9 kudos
How to Connect Databricks to Snowflake & Query Live Data?
Hi everyone,I am looking for a method to connect Databricks to Snowflake so I can query and transform the data directly in a notebook. I specifically want to avoid methods that just perform a one-time copy of the tables into Databricks, as I need the...
- 287 Views
- 7 replies
- 9 kudos
Latest Reply
- 9 kudos
Hello @Raj_DB, I took a look at both internal and external documentation and here is what I found. The thread already has the right answer: Lakehouse Federation. @saurabh18cs, @Harshad_B, @AbhilashNagilla, @Aravind_Reddy, @Jen_Evangelista and @balaji...
- 9 kudos
- 41 Views
- 0 replies
- 1 kudos
Giving AI the Meaning of Your Business: Genie Ontology, Metric Views and Governed Context
By @SrinuB in collaboration with @sridharplv Analytics · Governance · Any Team Putting Natural-Language Analytics in Front of Business Users — Define the Business Once, Let Genie Use It EverywhereAsk three people in a business "how many active custo...
- 41 Views
- 0 replies
- 1 kudos
- 49 Views
- 2 replies
- 6 kudos
Recording | Bricktalk: Zerobus Ingest & CDC Workflows
Explore Zerobus CDC with @Vicky_Bukta_DB , @OmkarMehta , @WagnerSantos and @Giselle_Go_DB
- 49 Views
- 2 replies
- 6 kudos
Latest Reply
- 6 kudos
@ThomazNeto I read your article and incorporated the tip you provided into an improvement I submitted to the Debezium project. I hope it can be available in Debezium Server 3.8!
- 6 kudos
- 92 Views
- 3 replies
- 0 kudos
Resolved! Schema evolution: new NOT NULL column fails on existing Silver data (Lakeflow Connect source)
Hi everyone,We ingest data from our source database with Lakeflow Connect, through a foreign catalog, into a Bronze layer. In the Silver layer, we apply the correct data types and constraints based on our data dictionary.Recently, some tables in the ...
- 92 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Good points already shared on the nullable → backfill → NOT NULL approach. I'd add a few Lakeflow Connect and Silver recovery considerations, particularly to avoid unnecessary full refreshes.1. Lakeflow Connect: Verify historical data before backfill...
- 0 kudos
- 294 Views
- 5 replies
- 0 kudos
Do non-ASCII characters in file names break document indexing over a Unity Catalog volume?
I spent a few days on a document retrieval problem that turned out to have nothing to do with the retrieval setup, and I want to check whether anyone else has hit the same thing.Setup: around 40 internal PDF documents in a managed Unity Catalog volum...
- 294 Views
- 5 replies
- 0 kudos
Latest Reply
- 0 kudos
Short answer from my test: the file names are not the problem. I ran ai_parse_document on a managed volume, and names with Swedish letters and spaces (both NFC and NFD forms) parsed fine, same as data_pulse found.One thing worth knowing: parse failur...
- 0 kudos
- 368 Views
- 6 replies
- 0 kudos
Databricks Apps gives you the app you wanted, without the React plumbing or the Power Apps limits
Most teams think they have to pick one. Build it in React and own the API, auth, hosting, and audit trail. Orbuild it in Power Apps and hit the limits when the app gets complex. With Databricks Apps, you don't have tochoose. You keep your React UI an...
- 368 Views
- 6 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Amar_Naik Good points! I would add three considerations when taking Databricks Apps from a PoC to production.1. Identity and data-level securityOne important distinction is between App Authorization and User Authorization.By default, each Databri...
- 0 kudos
- 184 Views
- 5 replies
- 6 kudos
Resolved! How do you collect Excel files from business users into Databricks ?
Hi everyone,I build reports in Databricks from Excel files maintained by many different business users. The files are varied and come from different teams, and I haven’t settled on an approach yet.One idea I’m considering: create a landing location w...
- 184 Views
- 5 replies
- 6 kudos
Latest Reply
- 6 kudos
You can use a Unity Catalog Volume backed by S3 as the landing zone and its the right way. You can give each source team their own folder in the volume, allowing users to drop files through the UI. Pipeline can pick up files on arrival using a job fi...
- 6 kudos
- 34 Views
- 0 replies
- 0 kudos
Certification Exam Suspended
Hello,While Taking the exam I got warned 3 times then suspension even when i explained to the support why my eye movements is like that still i got suspendedHere is the reference and Ticket Number#01066921Reference: ref:!00D610JGc4.!500Vp01GHdst:ref
- 34 Views
- 0 replies
- 0 kudos
- 1312 Views
- 2 replies
- 2 kudos
Upcoming Community BrickTalk | Zerobus Ingest & CDC Workflows
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, November 5! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 1312 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Hey Databricks Community!If anyone missed yesterday's awesome BrickTalk session, you can watch it here.
- 2 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1507 | |
| 1255 | |
| 1190 | |
| 961 |
Latest from our Blog
Controlling Genie budget under the new pay-as-you-go model
In my role as an architect and customer advisor, I often find that governance, security, and cost control come up together. That is understandable. As organisations move from AI experimentation to ent...
Gold Isn't Enough: Building the Context Layer for Conversational AI
Bronze, Silver, and Gold made data trustworthy. Conversational AI needs a 4th layer: governed meaning. Here's how to build it on Databricks. Two right answers, one wrong decision A VP of Customer Care...
How to stream PostgreSQL CDC into Databricks with Debezium
Data stored in operational databases powers critical business decisions, but making it available in the lakehouse presents significant architecture challenges. Strict enterprise environments could ha...
Governed Writes with SQL SECURITY DEFINER for Stored Procedures
SQL Stored Procedures in Databricks now support SQL SECURITY DEFINER, and it is Generally Available on SQL warehouses, Serverless compute and All-Purpose clusters (DBR 19+). A SECURITY DEFINER procedu...
