FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...
- 559 Views
- 3 replies
- 3 kudos
Wednesday
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 8, 2026! Bricktalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with Data...
- 176 Views
- 0 replies
- 2 kudos
yesterday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 1438 Views
- 0 replies
- 3 kudos
a month ago
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 176533 Views
- 280 replies
- 80 kudos
08-21-2026
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 4001 Views
- 1 replies
- 4 kudos
08-11-2026
Community Champion • Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individ...
- 960 Views
- 6 replies
- 7 kudos
2 weeks ago
Cybersecurity investigations often require sifting through large volumes of log and telemetry data to uncover the patterns and relationships behind threat activity. The Incident Investigation Using Graphistry Solution Accelerator shows how to query i...
- 36 Views
- 0 replies
- 0 kudos
8 hours ago
The Weekly Digest • September 7 – September 13 Community Pulse A new week, a fresh wave of articles, answers, and discussions. Here's your weekly catch-up. This Week's Community Stars The members who showed up and made a difference this week ...
- 444 Views
- 0 replies
- 4 kudos
2 weeks ago
Community Activity
- 184 Views
- 9 replies
- 0 kudos
Change data feed from a materialized view
Hi everyone,Trying the CDF on materialized view (declarative pipeline) feature that is currently in Beta.- Configuration:** Verified the MVs (materialized veiws) have: 'delta.enableRowTracking'SHOW TBLPROPERTIES my_mv ('delta.enableRowTracking'); re...
- 184 Views
- 9 replies
- 0 kudos
Latest Reply
- 0 kudos
Thanks for running the experiment, @cdn_yyz_yul. This one's useful, even though it failed. First, I owe you a correction. Last time I guessed version 3 failed because it was the first version in the freshly generated metadata log. Now version 28 fail...
- 0 kudos
- 517 Views
- 2 replies
- 3 kudos
Resolved! Designing an Effective "Quarantine" Pattern for Failed DLT Expectations
Hi everyone,I’m building out a production Medallion Architecture using Delta Live Tables (DLT), and I’m refining our strategy for handling data that fails Expectations.While expect_or_drop and expect_or_fail are straightforward, I’m struggling to fi...
- 517 Views
- 2 replies
- 3 kudos
Latest Reply
- 3 kudos
Hey @Khasim_1, this was an interesting one and I wanted to experiment a bit. I put this together if it helps - https://medium.com/lab-notes/three-lakeflow-quarantine-designs-tested-and-the-one-condition-every-queue-needs-1bea1c1588ff
- 3 kudos
- 32 Views
- 2 replies
- 0 kudos
DevOps Fundamentals: Lecture - DevOps Fundamentals: Repeated word
Section B. DevOps LifecycleRelease -> RELEASE the packaged application application ensuring it's ready for roll out
- 32 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Also:Section: F. DataOps = DevOps for Data EngineeringThe diagram introduces env mgmnt but never explains what it is.
- 0 kudos
- 130 Views
- 3 replies
- 1 kudos
Liquid clustering vs. partitioning for a 5 TB Silver table with frequent MERGEs
Hi all,We have a Silver Delta table (~5 TB, growing ~20 GB/day) that is updated every hour with a MERGE on order_id. Right now it's partitioned by order_date. Most MERGE batches touch the last 3 days, but late updates can reach orders up to 90 days o...
- 130 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi! Good candidate for liquid clustering, since the "hot 3 days plus a long tail of late updates" pattern is exactly where fixed date partitions start to hurt. A few thoughts on each question.MERGE performanceResults vary a lot by data distribution, ...
- 1 kudos
- 102 Views
- 2 replies
- 0 kudos
Declarative Pipeline Expectations - Quarantining Bad Records
Hi there,I'm trying to follow Expectation recommendations and advanced patterns | Quarantine invalid records, but this doesn't really make sense to me. Following the described pattern almost exactly in my case, I see that there are two TEMPORARY LIVE...
- 102 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi! The confusion here is understandable, because the docs example stops one step short of being useful on its own.Why the views show nothingTemporary views in a pipeline aren't materialized or published to Unity Catalog. They're logical building blo...
- 0 kudos
- 20 Views
- 0 replies
- 0 kudos
1.Not able to access interent (gcp databricks) 2.both ingress and egress access given
1.Not able to access interent (gcp databricks) 2.both ingress and egress access given in default policy2.How to overcome this issue and i am using serverless3.in free databricks able to use interent in gcp based databricks it is creating issueimport...
- 20 Views
- 0 replies
- 0 kudos
- 38 Views
- 1 replies
- 0 kudos
Implementing a "Zero-Bus" Architecture in a Lakehouse: Best Practices for Shared Dimensions?
Hi Everyone,I am currently architecting a Medallion Lakehouse and moving toward a "Zero-Bus" (Bus Architecture) approach. My goal is to ensure that our core dimensions—such as Customer, Product, and Geography—remain consistent and conformed across al...
- 38 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Great question. Here's what has worked for us.Conformation: We do entity resolution in Silver (a crosswalk mapping each source system's ID to one enterprise key, with survivorship rules), then publish conformed dimensions once as shared Gold tables t...
- 0 kudos
- 24 Views
- 0 replies
- 0 kudos
Tip: Why your Delta MERGE fails with "multiple source rows matched" (and the simple fix)
Hi everyone If you run incremental loads with MERGE INTO on Delta tables, you may have seen a merge fail with an error saying multiple source rows matched the same target row.Why it happensA MERGE compares each row in your source batch to your target...
- 24 Views
- 0 replies
- 0 kudos
- 45 Views
- 1 replies
- 0 kudos
Azure to AWS
Hi everyone,We're evaluating an architecture pattern and would appreciate any guidance or recommendations. Has anyone implemented a similar cross-cloud pattern? Specifically:Can AWS Glue be used to access Azure Databricks data without copying it?Are ...
- 45 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi everyone,We're evaluating an architecture pattern and would appreciate any guidance or recommendations.Current state:Source data resides in Azure Databricks.Consumers are in AWS .The source team allows read-only access but does not allow data repl...
- 0 kudos
- 225 Views
- 4 replies
- 0 kudos
WORKSPACE HAS NO DAILY TOKEN ALLOWANCE
Hello Team,When I try to debug and troubleshoot this error: "This workspace has no daily token allowance for the assistant. Ask your workspace admin to enable it, then try again." I am the Admin, but I still don't see any way to resolve this issue, I...
- 225 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
@HOguns Did you posted here, or Contacted Help Center with all of the details above?Ideally, you want to follow the below steps Use the Databricks Help Center if you can access it, and open a case for Azure Databricks → Genie Code/Assistant.If Help C...
- 0 kudos
- 38 Views
- 0 replies
- 0 kudos
Implementing a "Zero-Bus" Architecture with Unity Catalog
Hi everyone,I am currently refining the architecture for an end-to-end Lakehouse project and moving toward a "Zero-Bus" (Bus Architecture) model. My primary objective is to enforce dimension conformity (Customer, Product, Geography) across multiple i...
- 38 Views
- 0 replies
- 0 kudos
- 153 Views
- 2 replies
- 2 kudos
Trust in Genie isn't won with accuracy — it's won with a visible feedback loop accountability
A Finance team won't trust a Genie Room just because it's right. They trust it when they see someone is accountable for the answers. What worked for us: a thumbs up/down on every chat, and total transparency about who reads it. We had a dedicated Fi...
- 153 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @ivanvyd Completely agree on the two-owner model. For me the accountability piece is the key — putting a name against a metric puts a face to the issue, and suddenly it stops feeling like "the tool got it wrong" and starts feeling human. People tr...
- 2 kudos
- 67 Views
- 0 replies
- 0 kudos
Announcement | The Genie One MCP is now Generally Available
The Genie One MCP is now generally available for Databricks users, giving AI agents a governed way to access Genie One’s trusted insights across structured and unstructured data. Teams can bring consistent business context into Claude, ChatGPT, Curso...
- 67 Views
- 0 replies
- 0 kudos
- 33 Views
- 0 replies
- 0 kudos
How to make each person see only their specific data (i.e. their own rows in Genie) with RBAC & ABAC
When rolling Genie out to a UK enterprise Finance department, one of the questions was "will a cost-centre owner accidentally see another team's numbers?" In Finance, one leaked row is a bigger problem than a slightly clumsy chart. The good news: yo...
- 33 Views
- 0 replies
- 0 kudos
- 180 Views
- 4 replies
- 3 kudos
How to get people to actually choose Genie: train the mindset, not just the buttons
The hardest part of our Genie rollout wasn't building the room. It was 9am the next morning — when people still opened Excel. We rolled out a Genie Space to a UK enterprise Finance function (heavy excel users). The room was scoped well and the answer...
- 180 Views
- 4 replies
- 3 kudos
Latest Reply
- 3 kudos
hi @ThiamLee,Not sure if this is the right trail for your post, but maybe I can try to help. Can you post a separate post on this issue with a screenshot and we can see what can be done
- 3 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1454 | |
| 1253 | |
| 1187 | |
| 961 |
Latest from our Blog
Multi-region model serving on Databricks with OpenSharing
Introduction Enterprises today serve customers across continents, from New York to Singapore, London to São Paulo. For these organizations, delivering fast, reliable user experiences is a business req...
Tutorial: Databricks Genie for Data Engineers and Data Scientists
Note: This blog post is a summary of a Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub. Tutorial: Databricks Genie for Data Engineers and Data Scien...
Beyond the Dashboard: How Transferz Built a Truly Data-Driven Company Culture With AI/BI Genie
Transferz, a fast-growing travel tech platform, eliminated its data team bottleneck by deploying AI/BI Genie — achieving 89,5% adoption across business users achieving 60% operational improvements.Th...
5 Ways to Enhance Databricks AI/BI Dashboard Tables with HTML
Organizations use AI/BI dashboard tables to review accounts, catch problems, and decide what to do next. Yet a plain table can hold all the right data and still be hard to read. One way to improve the...
