cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 
Community Bricktalk | SQL-Native Vector Search

Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 29! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...

  • 282 Views
  • 0 replies
  • 0 kudos
Monday
Free, Hands-On Databricks Training: APAC Learning Festival

  DATABRICKS Asia-Pacific Learning Festival Free, virtual, hands-on Databricks training   21 & 22 October 2026 Virtual, labs included Free     Ready to level up your Databricks skills? The Databricks Asia-Pacific Learning Festival is back, and ...

  • 1819 Views
  • 1 replies
  • 1 kudos
2 weeks ago
Level Up Your Databricks Skills: Learning Paths & Free Live Training

FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...

  • 1850 Views
  • 3 replies
  • 6 kudos
4 weeks ago
DATA + AI World Tour 2026

REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...

  • 2490 Views
  • 0 replies
  • 3 kudos
09-01-2026
AI/BI + Genie Launchpad (Oct 20–22) | Free Hands-On Training

Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...

  • 798 Views
  • 0 replies
  • 0 kudos
a week ago
Databricks Community Champion - September 2026 - Venugopal Dabbara

Community Champion • September 2026 Meet Venugopal Dabbara Every month, our Community Champion Program recognizes a member who makes the Databricks Community better for everyone, through their knowledge, their willingness to help, and their commitmen...

  • 634 Views
  • 3 replies
  • 6 kudos
2 weeks ago
Solution Accelerator Series | Genome-Wide Association Studies

Genome-wide association studies help identify genetic variations associated with a disease or trait. The Genome-Wide Association Studies Solution Accelerator builds on Glow, an open source project for genomic analysis, to provide a fast, scalable and...

  • 155 Views
  • 0 replies
  • 1 kudos
Tuesday
🌟 Community Pulse: Your Community Roundup! September 14 – October 11, 2026

Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars   The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...

  • 180 Views
  • 0 replies
  • 3 kudos
Thursday

Community Activity

FrankAzzollini
by > • New Contributor III
  • 204 Views
  • 1 replies
  • 1 kudos

Document AI is a pipeline, not a model

When a financial document needs to be approved or rejected, there usually isn't one model making the decision.In the check / payment-slip systems I worked on, the pipeline looked more like this:1. Multimodal models + OCR to extract fields2. YOLO to d...

  • 204 Views
  • 1 replies
  • 1 kudos
Latest Reply
DoTA
Valued Contributor II
  • 1 kudos

On your closing question, the rule I'd use for the line: anything with a checkable ground truth, either inside the document or in a system of record, goes to deterministic logic, and the model only proposes. Amount in figures vs words, date validity,...

  • 1 kudos
DoTA
by > • Valued Contributor II
  • 24 Views
  • 0 replies
  • 0 kudos

Per-agent guardrails: what do you alert on, tokens, retries, or cost per task?

I'm trying to work out what a sensible guardrail looks like for each agent when several of them share a few serving endpoints.A plain token budget feels too blunt. An agent that retries a failing tool four times looks like a heavy user, while a cheap...

  • 24 Views
  • 0 replies
  • 0 kudos
PumpItUpper
by > • New Contributor II
  • 96 Views
  • 2 replies
  • 0 kudos

Enable non-DE teams to build their own pipelines

 Hi! In all the latest dbks events I keep hearing this idea of shifting away from a centralized data team, and enabling the final consumer teams to build their own data pipelines with Lakeflow instead. This seems the worst idea ever to me, and sounds...

  • 96 Views
  • 2 replies
  • 0 kudos
Latest Reply
DoTA
Valued Contributor II
  • 0 kudos

Your worry is fair, but I'd push on where the dividing line sits. I don't think it should be team role (DE vs analyst). I think it should be how many other people depend on the output.A table that only one analyst reads can be as fragile as they like...

  • 0 kudos
1 More Replies
Valeria_Koz_DBX
by • Databricks Employee
  • 67 Views
  • 1 replies
  • 2 kudos

What Is – a system table? (Your Databricks bank statement)

Clients ask me the same three questions all the time: What are system tables? What are they about? And what can I actually do with them? I recently came across a Databricks blog that answers the last one brilliantly: Top 5 System Table Queries for U...

  • 67 Views
  • 1 replies
  • 2 kudos
Latest Reply
DoTA
Valued Contributor II
  • 2 kudos

Nice explainer. To answer your closing question: the first thing I'd ask is what changed week over week by SKU. A cost jump is nearly always one product or one SKU, rarely the whole total moving evenly, so that view finds the culprit fastest.One gotc...

  • 2 kudos
Valeria_Koz_DBX
by • Databricks Employee
  • 346 Views
  • 1 replies
  • 2 kudos

How to build FinOps chargeback by cost centre — allocating the whole cloud bill, not just your DBUs

Every IT function I've worked with eventually asks the same question, and can never answer it cleanly and clearly: "What did each team actually cost us last month?"When speaking with the platform team at a large UK bank, the realisation was that the ...

  • 346 Views
  • 1 replies
  • 2 kudos
Latest Reply
DoTA
Valued Contributor II
  • 2 kudos

Good pattern. Two things I'd add for anyone copying this, since they're the parts that tend to surprise people afterwards.1. Tags are not retroactive. A usage row written without a team tag stays untagged forever. For history you can still attribute ...

  • 2 kudos
Louis_Frolio
by • Databricks Employee
  • 1906 Views
  • 8 replies
  • 6 kudos

What's Your Biggest AI Pet Peeve?

Hey Team, in my last post I asked how much AI has actually changed your day to day, and the responses were fantastic. But let's talk about the other side for a minute. I'll go first — I've started second-guessing almost everything I see on social med...

Screenshot 2026-03-30 at 2.26.48 PM.png
  • 1906 Views
  • 8 replies
  • 6 kudos
Latest Reply
Clara1Whitmore
New Contributor
  • 6 kudos

One common AI pet peeve is when responses sound confident but miss the actual question, so improving accuracy, transparency, and context awareness would make AI tools more useful. Treating nail infections early stops paronychia from reaching the toe ...

  • 6 kudos
7 More Replies
srikanthp24
by > • New Contributor III
  • 123 Views
  • 3 replies
  • 0 kudos

About Azure SQL Managed Connector

Hi Community,We are trying to configure a Databricks Lakeflow Connect managed SQL Server connector to ingest data from Azure SQL Database into Databricks.We are using a contained SQL database user that has access only to the specific source database,...

  • 123 Views
  • 3 replies
  • 0 kudos
Latest Reply
Nirmata
New Contributor
  • 0 kudos

Adding to @balajij8’s answer: the reason a contained user can’t work is that ##MS_DatabaseConnector## is a server-level role, and server roles take logins from master, not database users. That’s the access the connector needs to reach master.To keep ...

  • 0 kudos
2 More Replies
Charansai
by > • New Contributor III
  • 101 Views
  • 2 replies
  • 0 kudos

PIM for Groups with Databricks: users appear in group without activating, nothing shows in PIM to ac

Hi everyone,We’re setting up just-in-time read access to a Unity Catalog catalog for a small audit team using Microsoft Entra PIM for Groups, and I’d like to check whether our setup is right.SetupAzure Databricks with account-level SCIM provisioning ...

  • 101 Views
  • 2 replies
  • 0 kudos
Latest Reply
Nirmata
New Contributor
  • 0 kudos

Hi @Charansai — we use a similar pattern for audit access in a regulated (GxP) environment, so taking your questions in order:1. Why the 5 users are already members. Eligible PIM members aren’t actual group members until they activate, and SCIM provi...

  • 0 kudos
1 More Replies
volodymyr_b
by > • New Contributor
  • 113 Views
  • 2 replies
  • 0 kudos

Possible bug in Lakeflow Connect SQL Server ingestion with GUID primary keys – Missing records

Hi everyone,We've encountered a strange issue with Databricks Lakeflow Connect query-based ingestion from SQL Server, and I'm wondering if anyone else has experienced something similar.We have a SQL Server table with 1,448 records and a uniqueidentif...

  • 113 Views
  • 2 replies
  • 0 kudos
Latest Reply
Nirmata
New Contributor
  • 0 kudos

Hi @volodymyr_b — I think your theory is right, and your own log line backs it up.SQL Server doesn’t sort uniqueidentifier the way the string sorts. It compares the last 6-byte group first (the FFE14F608876 part), then works backward through the othe...

  • 0 kudos
1 More Replies
orlandovallejos
by > • New Contributor
  • 124 Views
  • 3 replies
  • 1 kudos

External location Manage permission

Hi team, I'm trying to update the owner of an external location and I see the following message:Requires permission MANAGE on external location 'location_name'The owner of the resource, the user that created it doesn't have that permission? How is th...

Screenshot 2026-10-16 at 12.21.09 PM.png
  • 124 Views
  • 3 replies
  • 1 kudos
Latest Reply
ShamenParis
Contributor III
  • 1 kudos

Hi @orlandovallejos , Check the Permissions tab to view access rights. If you can't see the external location permissions, reach out to your admin team. Keep in mind that these permissions are tied to the metastore, not the workspace

  • 1 kudos
2 More Replies
ShamenParis
by > • Contributor III
  • 31 Views
  • 0 replies
  • 0 kudos

The Databricks Serverless Conversion Playbook

The shift from classic compute to Serverless in Databricks is a game-changer, but the migration process requires a solid strategy. After diving deep into serverless conversions recently, I’ve put together a guided playbook.Here are my top 5 takeaways...

Databricks Serverless Conversion Playbook.jpg Databricks Serverless Conversion Playbook 2.jpg Databricks Serverless Conversion Playbook 3.jpg
  • 31 Views
  • 0 replies
  • 0 kudos
MouR
by > • Databricks Partner
  • 65 Views
  • 0 replies
  • 0 kudos

Palantir Foundry + Databricks: Move the Data or Just Read It?

Sometimes the cheapest migration is no migration at all.An organization has already invested in Palantir Foundry, with established pipelines, validated data, Ontology models and operational applications. Another team wants to use the same data in Dat...

palantir_1.png palantir_2.png palantir_3.png palantir_4.png
Community Articles
AzureDatabricks Palantir Federation Accenture Avanade AWSDatabricks Migration
  • 65 Views
  • 0 replies
  • 0 kudos
andreas-kopp_da
by • Databricks Employee
  • 1330 Views
  • 1 replies
  • 5 kudos

Beyond Prompting: Production-Ready Image Generation and Visual Asset Management on Databricks

Image Generation in the Enterprise For agencies, creative studios, retailers, and media companies, visual assets are core to the business. Better image generation can directly improve output, speed, and revenue. But visuals matter far beyond creative...

andreaskopp_da_0-1786530387184.png andreaskopp_da_1-1786530469451.png andreaskopp_da_3-1786530664613.png andreaskopp_da_4-1786530697064.png
  • 1330 Views
  • 1 replies
  • 5 kudos
Latest Reply
tashavi
New Contributor
  • 5 kudos

AI image generation is making it easier for businesses to create visual content efficiently. Alongside visual innovation, reliable information about people and their achievements also matters. Readers use the biography pages to learn who someone real...

  • 5 kudos
aayush_410
by > • New Contributor III
  • 49 Views
  • 0 replies
  • 0 kudos

How New Developers Learn Databricks Genie: A Practical Learning Path

If you are new to the Databricks ecosystem, you have probably heard the name Genie in a demo, a keynote, or a hallway conversation. The pitch is simple and a little magical: ask a question about your data in plain English, and get back a table, a cha...

  • 49 Views
  • 0 replies
  • 0 kudos
i4ata
by > • New Contributor II
  • 137 Views
  • 3 replies
  • 2 kudos

Databricks Connect + AutoDependencies + UDF + Streaming breaks

I have this toy python script:CATALOG = 'mpt_usd_gbl_bronze_dev' # <-- replaceSCHEMA = 'mpt_gbl_tco_fof' # <-- replacesrc=f'{CATALOG}.{SCHEMA}.toy_source'DEST = f'{CATALOG}.{SCHEMA}.toy_dest'from databricks.connect import DatabricksSession, Databrick...

  • 137 Views
  • 3 replies
  • 2 kudos
Latest Reply
i4ata
New Contributor II
  • 2 kudos

Thanks for the reply and apologies for the typos in the snippet! I tried to get withDependencies() to work but as my UDF was requiring an external package, it was still failing. It can be replicated with the following snippet:CATALOG = 'catalog' # <-...

  • 2 kudos
2 More Replies
Welcome to the Databricks Community!

Once you are logged in, you will be ready to post content, ask questions, participate in discussions, earn badges, and more.

Spend a few minutes exploring Get Started Resources, Learning Paths, Certifications, and Platform Discussions.

Join Learning Events here in the Community.

Connect with peers through Databricks User Groups and learn more about Community Events happening near you. We’re excited to see you get involved.

Top Kudoed Authors

Latest from our Blog

Introducing session restore for serverless jobs

Serverless jobs make it easy to run production notebook workloads at scale, but until now, the state of a run was gone once it ended. If a pipeline ran for hours and failed on the last step, the varia...

425Views 1kudos