cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 
✈️ 9 Cities, 1 Epic November: The Data + AI World Tour is Here!

NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...

  • 1780 Views
  • 1 replies
  • 1 kudos
2 weeks ago
DATA + AI LIVE | Context Is Just the Beginning: Meet your data smart AI coworker

DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...

  • 1329 Views
  • 0 replies
  • 2 kudos
2 weeks ago
DATA + AI World Tour 2026

REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...

  • 3966 Views
  • 0 replies
  • 4 kudos
09-01-2026
AI/BI + Genie Launchpad (Nov 3-5) | Free Hands-On Training

Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...

  • 1055 Views
  • 0 replies
  • 1 kudos
2 weeks ago
Solution Accelerator Series | Responsible Gaming

Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...

  • 665 Views
  • 1 replies
  • 5 kudos
2 weeks ago
🌟 Community Pulse: Your Community Roundup! September 14 – October 11, 2026

Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars   The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...

  • 854 Views
  • 0 replies
  • 4 kudos
3 weeks ago

Community Activity

rcoluccio
by • Databricks Employee
  • 54 Views
  • 0 replies
  • 1 kudos

An example of AI coworker for people who have never queried data

An example of AI coworker for people who have never queried data Talking to your data doesn't mean your data understands you. AI knows data and query languages, but it must also learn the specific jargon people use on the job to interpret what they r...

rcoluccio_0-1793401690919.jpeg rcoluccio_1-1793401690920.png rcoluccio_2-1793401690920.png rcoluccio_3-1793401690920.png
  • 54 Views
  • 0 replies
  • 1 kudos
chris0991
by > • New Contributor III
  • 4367 Views
  • 6 replies
  • 1 kudos

Best practices for optimizing Spark jobs

What are some best practices for optimizing Spark jobs in Databricks, especially when dealing large datasets? Any tips or resources would be greatly appreciated! I’m trying to analyze data on restaurant menu prices so that insights would be especiall...

  • 4367 Views
  • 6 replies
  • 1 kudos
Latest Reply
Harshad_B
New Contributor III
  • 1 kudos

Answer to this overall depends on your design and data model, some good practices can be followed but you might have to determine what best fits your design. Quick tips -File Format & Sizing: Use columnar formats (Parquet/ORC) with zstd or snappy com...

  • 1 kudos
5 More Replies
ryanforsythe8
by > • Visitor
  • 56 Views
  • 2 replies
  • 0 kudos

Unable to user serverless GPU

I am currently using a premium plan, it was set up as a managed databricks account (no attached cloud account). I do have a credit card attached to the account, so it does not say "free trial". When I try to use a serverless GPU, I get the error "An ...

  • 56 Views
  • 2 replies
  • 0 kudos
Latest Reply
ryanforsythe8
  • 0 kudos

Thanks for the response, that is the same error that I am getting but according to the documentation I should have access. I am on a premium tier (credit card entered) workspace, on AWS in the us-east-2 region. According to documentation for AWS serv...

  • 0 kudos
1 More Replies
saurabh18cs
by > • Honored Contributor III
  • 40 Views
  • 0 replies
  • 0 kudos

Databricks Exclusive Access

I’m exploring how to set up exclusive access for separate use cases implementation within a shared Databricks workspace, using Microsoft Entra groups and Unity Catalog. I’d love to hear from anyone who has implemented something similar, or is current...

  • 40 Views
  • 0 replies
  • 0 kudos
kapil_dua
by > • Databricks Partner
  • 214 Views
  • 4 replies
  • 0 kudos

Data Ingestion Lakeflow UI Bug - Does not allow to create streaming table with BINARY data type

Data Ingestion (Lakeflow) Feature Bug:While creating Data Ingestion streaming table for ingesting pdf files, so that it can store into Binary format, it doesn't allow to select for BINARY data type for a column like (content), but it chose default da...

  • 214 Views
  • 4 replies
  • 0 kudos
Latest Reply
saurabh18cs
Honored Contributor III
  • 0 kudos

Hi @kapil_dua This works for me so what are you doing differently?  

  • 0 kudos
3 More Replies
NaniOnyx07
by > • New Contributor
  • 91 Views
  • 2 replies
  • 2 kudos

Unable to Attach Databricks Serverless Compute – Environment Version 5 (Heavy Load Warning)

Hi Databricks Community,I'm experiencing an issue with Databricks Serverless Compute while trying to attach it to my notebook using Serverless Environment Version 5.Whenever I attempt to attach the compute, I receive the following warning: "Databrick...

Screenshot 2026-11-06 085609.png
  • 91 Views
  • 2 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Hello @NaniOnyx07, I took a look at both internal and external documentation and here is what I found. First, credit to @ThomazNeto for the thorough first pass. I checked his facts against the docs and he is spot on: environment version 5 shipped in ...

  • 2 kudos
1 More Replies
Debu-Sinha
by • Databricks Employee
  • 303909 Views
  • 5 replies
  • 10 kudos

The Ultimate Guide to Chunking Strategies for RAG Applications with Databricks

Over the years, I have collaborated closely with ML engineering leaders across various industries, guiding them on how to make the right chunking strategy decisions for their Retrieval-Augmented Generation (RAG) use cases. One of the biggest challeng...

Screenshot 2025-04-03 at 10.45.07 PM.png
  • 303909 Views
  • 5 replies
  • 10 kudos
Latest Reply
Indrakiran
Visitor
  • 10 kudos

Nice explanation

  • 10 kudos
4 More Replies
Khasim_1
by > • Contributor
  • 393 Views
  • 4 replies
  • 3 kudos

Unity Catalog external location access error after metastore attachment

Hi everyone,I am running into a permission issue when trying to query data from an external S3 storage location managed through Unity Catalog.Here are the symptoms:The Setup: Storage credentials and an external location were successfully created, and...

  • 393 Views
  • 4 replies
  • 3 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 3 kudos

Hello @Khasim_1, I took a look at both internal and external documentation and here is what I found. First, credit to @data_pulse, @pradeep_singh and @saurabh18cs, who've already laid out the standard triage. Capture the exact error. Confirm the job'...

  • 3 kudos
3 More Replies
Raj_DB
by > • Contributor
  • 299 Views
  • 7 replies
  • 9 kudos

How to Connect Databricks to Snowflake & Query Live Data?

Hi everyone,I am looking for a method to connect Databricks to Snowflake so I can query and transform the data directly in a notebook. I specifically want to avoid methods that just perform a one-time copy of the tables into Databricks, as I need the...

  • 299 Views
  • 7 replies
  • 9 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 9 kudos

Hello @Raj_DB, I took a look at both internal and external documentation and here is what I found. The thread already has the right answer: Lakehouse Federation. @saurabh18cs, @Harshad_B, @AbhilashNagilla, @Aravind_Reddy, @Jen_Evangelista and @balaji...

  • 9 kudos
6 More Replies
SrinuB
by > • New Contributor II
  • 61 Views
  • 0 replies
  • 1 kudos

Giving AI the Meaning of Your Business: Genie Ontology, Metric Views and Governed Context

By @SrinuB  in collaboration with @sridharplv Analytics · Governance · Any Team Putting Natural-Language Analytics in Front of Business Users — Define the Business Once, Let Genie Use It EverywhereAsk three people in a business "how many active custo...

blog3_two_contexts.png blog3_playbook.png
  • 61 Views
  • 0 replies
  • 1 kudos
Tushar_Parekar
by • Databricks Employee
  • 101 Views
  • 2 replies
  • 6 kudos

Recording | Bricktalk: Zerobus Ingest & CDC Workflows

Explore Zerobus CDC with @Vicky_Bukta_DB , @OmkarMehta , @WagnerSantos and @Giselle_Go_DB 

Bricktalk_final.png
  • 101 Views
  • 2 replies
  • 6 kudos
Latest Reply
WagnerSantos
Databricks Employee
  • 6 kudos

@ThomazNeto I read your article and incorporated the tip you provided into an improvement I submitted to the Debezium project. I hope it can be available in Debezium Server 3.8!

  • 6 kudos
1 More Replies
faruk
by > • Contributor II
  • 104 Views
  • 3 replies
  • 0 kudos

Resolved! Schema evolution: new NOT NULL column fails on existing Silver data (Lakeflow Connect source)

Hi everyone,We ingest data from our source database with Lakeflow Connect, through a foreign catalog, into a Bronze layer. In the Silver layer, we apply the correct data types and constraints based on our data dictionary.Recently, some tables in the ...

  • 104 Views
  • 3 replies
  • 0 kudos
Latest Reply
data_pulse
Contributor
  • 0 kudos

Good points already shared on the nullable → backfill → NOT NULL approach. I'd add a few Lakeflow Connect and Silver recovery considerations, particularly to avoid unnecessary full refreshes.1. Lakeflow Connect: Verify historical data before backfill...

  • 0 kudos
2 More Replies
suranga
by > • Databricks Partner
  • 299 Views
  • 5 replies
  • 0 kudos

Do non-ASCII characters in file names break document indexing over a Unity Catalog volume?

I spent a few days on a document retrieval problem that turned out to have nothing to do with the retrieval setup, and I want to check whether anyone else has hit the same thing.Setup: around 40 internal PDF documents in a managed Unity Catalog volum...

  • 299 Views
  • 5 replies
  • 0 kudos
Latest Reply
okinashchuk
New Contributor III
  • 0 kudos

Short answer from my test: the file names are not the problem. I ran ai_parse_document on a managed volume, and names with Swedish letters and spaces (both NFC and NFD forms) parsed fine, same as data_pulse found.One thing worth knowing: parse failur...

  • 0 kudos
4 More Replies
Amar_Naik
by > • New Contributor II
  • 375 Views
  • 6 replies
  • 0 kudos

Databricks Apps gives you the app you wanted, without the React plumbing or the Power Apps limits

Most teams think they have to pick one. Build it in React and own the API, auth, hosting, and audit trail. Orbuild it in Power Apps and hit the limits when the app gets complex. With Databricks Apps, you don't have tochoose. You keep your React UI an...

Genie Hub
Databricks Apps
DELTA SHARING
Genie
Unity Catalog
  • 375 Views
  • 6 replies
  • 0 kudos
Latest Reply
Aravind_Reddy
Databricks Partner
  • 0 kudos

Hi @Amar_Naik Good points! I would add three considerations when taking Databricks Apps from a PoC to production.1. Identity and data-level securityOne important distinction is between App Authorization and User Authorization.By default, each Databri...

  • 0 kudos
5 More Replies
faruk
by > • Contributor II
  • 191 Views
  • 5 replies
  • 6 kudos

Resolved! How do you collect Excel files from business users into Databricks ?

Hi everyone,I build reports in Databricks from Excel files maintained by many different business users. The files are varied and come from different teams, and I haven’t settled on an approach yet.One idea I’m considering: create a landing location w...

  • 191 Views
  • 5 replies
  • 6 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 6 kudos

You can use a Unity Catalog Volume backed by S3 as the landing zone and its the right way. You can give each source team their own folder in the volume, allowing users to drop files through the UI. Pipeline can pick up files on arrival using a job fi...

  • 6 kudos
4 More Replies
Welcome to the Databricks Community!

Once you are logged in, you will be ready to post content, ask questions, participate in discussions, earn badges, and more.

Spend a few minutes exploring Get Started Resources, Learning Paths, Certifications, and Platform Discussions.

Join Learning Events here in the Community.

Connect with peers through Databricks User Groups and learn more about Community Events happening near you. We’re excited to see you get involved.

Top Kudoed Authors

Latest from our Blog