Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 29! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 583 Views
- 0 replies
- 2 kudos
2 weeks ago
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, November 5! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 155 Views
- 0 replies
- 2 kudos
Thursday
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 430 Views
- 0 replies
- 1 kudos
Wednesday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 2916 Views
- 0 replies
- 4 kudos
09-01-2026
Community Champion • September 2026 Meet Venugopal Dabbara Every month, our Community Champion Program recognizes a member who makes the Databricks Community better for everyone, through their knowledge, their willingness to help, and their commitmen...
- 811 Views
- 3 replies
- 7 kudos
3 weeks ago
Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...
- 128 Views
- 1 replies
- 2 kudos
Thursday
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 447 Views
- 0 replies
- 4 kudos
a week ago
Community Activity
- 376 Views
- 4 replies
- 1 kudos
Row level Data MASKING on multiple tables
Hi Community,I'm looking for guidance on implementing row-level masking (RLM) at scale in Databricks using Unity Catalog.Our challenge is that we have schemas containing a large number of tables (for example, one schema contains approximately 120 tab...
- 376 Views
- 4 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @ChristophIRE,Building on the replies above, here is a rollout checklist for the tag-based ABAC approach, with code.Coverage check per tableFor each table, record which sensitive columns match the policy and where the entitlement key comes from. A...
- 1 kudos
- 422 Views
- 3 replies
- 3 kudos
Databricks Asset Bundles: How to manage dependencies between volumes/files and cluster creation?
Problem Statement:I have a Databricks Asset Bundles (DAB) project with the following requirement:I need to create an all-purpose cluster whose configuration references:An init script stored at /Volumes/<catalog>/<schema>/<volume>/scripts/init_script...
- 422 Views
- 3 replies
- 3 kudos
Latest Reply
- 3 kudos
Hello @geramkumar, Following up on @SumeshKashyap's answer with the doc references, plus a few points to check on option 2, since you plan to explore it. The current docs also take the second deploy out of most releases. Bundles still have no resourc...
- 3 kudos
- 4063 Views
- 7 replies
- 26 kudos
Databricks Community Champion - March 2026 - Pradeep Singh
Our Community Champion Program celebrates members who go the extra mile to share knowledge, support fellow practitioners, and help the Databricks Community grow stronger every day. These champions bring curiosity, experience, and a genuine willin...
- 4063 Views
- 7 replies
- 26 kudos
- 37 Views
- 0 replies
- 0 kudos
Quest 5 Complete - Engineering handbook knowledge base with RAG, deployed on Databricks Apps.
I have customed Lakebase starter app (Quest 4) into an engineering handbook knowledge base with RAG, deployed on Databricks Apps.
- 37 Views
- 0 replies
- 0 kudos
- 35 Views
- 0 replies
- 0 kudos
Which context improves Genie accuracy most? I benchmarked 4 layers
I wanted to know which kind of business context actually moves Genie's accuracy, so I ran a small benchmark on samples.wanderbricks: 30 questions (15 scenarios in 2 phrasings), each with ground-truth SQL, adding one layer of context at a time in a ne...
- 35 Views
- 0 replies
- 0 kudos
- 2510 Views
- 15 replies
- 2 kudos
Unable to Enable Unity Catalog – Azure Managed Identity Credential Not Found
Hi Databricks Community,I am trying to enable Unity Catalog in my Azure Databricks account. As part of the setup, I created an Azure Databricks Access Connector and assigned its managed identity the required permissions on my ADLS Gen2 storage accoun...
- 2510 Views
- 15 replies
- 2 kudos
Latest Reply
- 2 kudos
i have created access connector,storage account and databricks resource in same region.Reader and Storage Actions Blob Data Operator access are given.still getting below error Azure Managed Identity Credential with Access Connector Id /subscriptions/...
- 2 kudos
- 34 Views
- 0 replies
- 0 kudos
From Interactive Map to Databricks MVP Mini-Game
I created Databricks XPedition — an interactive map designed to make exploring the Databricks ecosystem a little more fun. But then I thought… why stop at a map when we could turn the whole experience into a game?And that's how the first Databricks M...
- 34 Views
- 0 replies
- 0 kudos
- 265 Views
- 4 replies
- 0 kudos
Feature Request: Cross-job dependencies with business-date awareness
SummaryWorkflows can chain tasks inside one job, but there is no native way to say: “Run job X once per day, after jobs A, B, C, D and E have each completed successfully for the same business date, even though they are independent jobs with their own...
- 265 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
@indradbxlearn Two suggestions for the open items. First, make the control-table write a standard final task in each dimension job, so the job can't succeed without writing its row. Second, for reruns: count repairs that finish before the fact load, ...
- 0 kudos
- 59 Views
- 1 replies
- 1 kudos
- 59 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Looking forward to exploring how Agent Bricks enables production-ready AI agents on enterprise data—especially its practical applications in building scalable, secure, and reliable GenAI solutions!
- 1 kudos
- 134 Views
- 4 replies
- 0 kudos
Materialized View with Incremental Refresh - Change Data Feed required on source tables?
Question:To create a materialized view with incremental refresh, is the Delta Lake feature Change Data Feed required on all of the source tables that the materialized view consumes? Or, is it not required for the creation of the materialized view, bu...
- 134 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
@johnb1 - Hello Johnb1 - CDF is not required, either to create the materialized view or to refresh it incrementally. The current Databricks docs (updated October 2026) list it only as a recommendation for better performance.Row tracking is what can ...
- 0 kudos
- 173 Views
- 3 replies
- 1 kudos
Why Is Outbound Internet Access Restricted on GCP Databricks Serverless?
I'm using Databricks on GCP, apparently on the Premium tier, and Serverless compute blocks requests to public websites such as Google and data.gov.au.I would expect a paid Databricks workspace to support basic outbound HTTPS requests.Unfortunately, t...
- 173 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
I've spent several days troubleshooting this issue, trying various workarounds, including VPNs, proxies, and SSH tunneling, just to keep my project moving.The logs confirm that Databricks Serverless is actively blocking outbound DNS requests (DROP, r...
- 1 kudos
- 869 Views
- 6 replies
- 7 kudos
Resolved! Unity Catalog v.2.0?
Are there plans for a v.2.0 of Unity Catalog? I find the organization of tables in databricks to be very constrained and inflexible. Given that UC tables have their origins in data lakes, you would think they would have brought a lot more flexibile...
- 869 Views
- 6 replies
- 7 kudos
Latest Reply
- 7 kudos
Fair points, especially for data coming from systems with richer naming. I can't speak to the roadmap, but here's what works for us today:Aliases: Create views in a consumer-facing catalog, like reporting.sales.outside_sales, that point to the real t...
- 7 kudos
- 2346 Views
- 2 replies
- 4 kudos
How to Unit Test Spark Declarative Pipelines
Every engineer who ships application code writes unit tests for it. Yet the data pipeline that feeds the same application is often left with a manual run and a dashboard that someone eventually notices is wrong. The gap has been more about tooling th...
- 2346 Views
- 2 replies
- 4 kudos
Latest Reply
- 4 kudos
Great article. The native TestPipeline and test_spark APIs are a promising step towards first-class unit testing for SDP.One potential enhancement would be execution outside the Lakeflow Pipelines Editor.As documented, native test execution is curren...
- 4 kudos
- 61 Views
- 0 replies
- 1 kudos
Declarative Automation Bundles
Databricks Declarative Automation Bundles Abri um pull request que apagava um job. O plan mostrou “delete jobs.sample_job”, o check ficou verde e o merge liberou.Se eu clicasse, o job sumia de HML na hora e, depois da aprovação, de PRD também.O CLI ...
- 61 Views
- 0 replies
- 1 kudos
- 112 Views
- 1 replies
- 1 kudos
Do We Need a New Role in Data Organizations — The Semantic Steward?
As data platforms evolve from managing data to managing business meaning, is it time to introduce a new role: Semantic Steward?Traditionally, data governance has focused on data quality, ownership, security, lineage, and compliance.But with the rise ...
- 112 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Venkat, your point about different business teams defining 'Revenue' or 'Active Customer' differently is a classic source of friction. I've seen this in almost every implementation, and you're right that even with perfect data quality, inconsistent s...
- 1 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1504 | |
| 1255 | |
| 1189 | |
| 961 |
Latest from our Blog
AI Functions for Synthetic Test Data: Generate Realistic Datasets in Pure SQL
The views expressed in this post are my own and do not represent those of my employer. Not long ago, generating realistic synthetic data meant building custom pipelines with GANs, Transformers, or RN...
Databricks maintenance and cleanup: Visualize, Clean, and Log with Declarative Automation Bundles
Introduction Managing Databricks environments can quickly become overwhelming as jobs, AI Search indexes, and pipeline artifacts accumulate, making manual cleanup, logging, and compliance difficult. T...
Locate, Measure, Judge: A Pattern for Verifiable Visual AI on Databricks (Part 2)
Part 1 introduced the pattern for verifiable visual AI. Let the model find the evidence, use deterministic code to measure it, apply governed rules to produce a pass, review, or fail verdict, and send...
Locate, Measure, Judge: A Pattern for Verifiable Visual AI on Databricks (Part 1)
AI adoption has moved much faster than measurable business results. McKinsey reports that 88% of organizations now use AI in at least one business function, yet only 39% see a bottom-line effect. A co...
