FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...
- 357 Views
- 1 replies
- 2 kudos
Wednesday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 1303 Views
- 0 replies
- 3 kudos
4 weeks ago
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 164629 Views
- 261 replies
- 77 kudos
08-21-2026
Virtual Event Time: AMER Sept 23 / 9 AM PTEMEA Sept 24 / 9 AM BST / 10 AM CESTAPJ Sept 24 / 9:30 AM IST / 12 PM SGT / 1 PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: Marking RSVP on this Community ...
- 1154 Views
- 0 replies
- 2 kudos
4 weeks ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 3679 Views
- 0 replies
- 3 kudos
08-11-2026
Community Champion • Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individ...
- 896 Views
- 6 replies
- 7 kudos
2 weeks ago
Public sector agencies need well-informed decisions to support the livelihood and security of citizens. The Entity Resolution for Public Sector Solution Accelerator shows how entity resolution can connect disparate data sources, reveal relationships ...
- 265 Views
- 0 replies
- 1 kudos
Wednesday
The Weekly Digest • September 7 – September 13 Community Pulse A new week, a fresh wave of articles, answers, and discussions. Here's your weekly catch-up. This Week's Community Stars The members who showed up and made a difference this week ...
- 388 Views
- 0 replies
- 4 kudos
2 weeks ago
Community Activity
- 7950 Views
- 6 replies
- 1 kudos
SQL week format issue its not showing result as 01(ww)
Hi Folks,I've requirement to show the week number as ww format. Please see the below codeselect weekofyear(date_add(to_date(current_date, 'yyyyMMdd'), +35)). also plz refre the screen shot for result.
- 7950 Views
- 6 replies
- 1 kudos
Latest Reply
- 1 kudos
Data engineering is an increasingly important field, and communities focused on best practices and practical solutions can be valuable for professionals at every level. Discussions about architecture, optimization, data pipelines, and efficient workf...
- 1 kudos
- 294782 Views
- 35 replies
- 74 kudos
Metadata-Driven ETL Framework in Databricks (Part-1)
In modern data-driven enterprises, data flows like lifeblood through complex systems and repositories to drive decision-making and innovation. Each dataset, whether structured or unstructured, holds the potential to unlock insights and drive innovati...
- 294782 Views
- 35 replies
- 74 kudos
- 217 Views
- 4 replies
- 1 kudos
State of AI Agents
Three years ago, provisioning a test database at work meant a full ticket cycle with my name on the approval. Last week I watched an analyst spin one up in under a minute using an AI agent, no ticket, no wait.I did not expect database administration ...
- 217 Views
- 4 replies
- 1 kudos
Latest Reply
- 1 kudos
I'm fine turning over development to AI agents, but I still feel like confirmation and certain actions need to lie in the hands of humans. Maybe I'm being too cautious, but I'd rather be safe than sorry in those cases.
- 1 kudos
- 179 Views
- 5 replies
- 5 kudos
Genie Agent SDK visualization
The documentation says you can send in an optional enable_visualization boolean when starting a conversation or sending a message to the agent:start_conversation_and_wait(space_id: str, content: str [, enable_visualization: Optional[bool], timeout: d...
- 179 Views
- 5 replies
- 5 kudos
Latest Reply
- 5 kudos
Great, thanks for confirming!Since the signature now includes enable_visualization, it looks like the SDK itself was correct and the issue was most likely related to the Python process still using a previously loaded version/module.Restarting the Pyt...
- 5 kudos
- 49 Views
- 0 replies
- 1 kudos
Architecting a Medallion Lakehouse
Hi Everyone,Recently, I led an end-to-end Lakehouse project for a client that was struggling with manual, error-prone reporting and disconnected data silos. Their core business problem was simple yet critical: the business could not trust its own num...
- 49 Views
- 0 replies
- 1 kudos
- 211 Views
- 5 replies
- 1 kudos
Serverless DNS failures after trial upgrade (AWS us-east-2)
Our AWS Premium serverless workspace in us-east-2 cannot resolve several public domains. We added a payment method, and the account UI confirms that the trial upgrade is complete.Three fresh serverless notebook runs on September 24, 2026, at approxim...
- 211 Views
- 5 replies
- 1 kudos
Latest Reply
- 1 kudos
@revian We are also seeing a similar issue where serverless can't access the public internet although egress is enabled. We are also on Premium and using AWS as our cloud.Another issue we are facing is that we are unable to access any Unity Catalog e...
- 1 kudos
- 41 Views
- 0 replies
- 0 kudos
Balancing Model Agility and Centralized Governance with Mosaic AI Gateway
Hi everyone,I’m currently evaluating the role of the AI Gateway in a Medallion Architecture implementation. While the ability to centralize rate limiting and credential management is a clear win for production stability, I’m interested in how others ...
- 41 Views
- 0 replies
- 0 kudos
- 73 Views
- 1 replies
- 1 kudos
Configuring Genie: practical steps for more reliable answers
I published a hands-on guide to preparing and testing a Genie Agent, using a small sales dataset with known resultsA few practices covered:Define table grain and relationships to avoid inflated totals after joins.Document metric definitions, currenci...
- 73 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Great guide, Arthur! I particularly agree with your point on defining table grain and relationships—those are often the silent killers of 'Genie' accuracy, especially when joins inflate totals. In my current work with complex medallion architectures,...
- 1 kudos
- 229 Views
- 2 replies
- 4 kudos
Architectural Pattern for PII: "Redact at Ingestion" vs. "Dynamic Masking at Consumption
Hi everyone, we are defining our PII strategy in Unity Catalog. We are split on whether to: A) Redact/Hash PII at the Silver layer (permanent change), or B) Keep PII in Silver and use Dynamic Data Masking at the Gold/View layer.Does "Redact at Inges...
- 229 Views
- 2 replies
- 4 kudos
Latest Reply
- 4 kudos
Hey @Khasim_1 , if it helps...did an experiment and blog post with results from the run that illustrates the pattern that @Ashwin_DSArecommended.https://medium.com/lab-notes/redacting-pii-in-silver-leaves-it-in-bronze-column-masks-vs-redaction-on-dat...
- 4 kudos
- 94 Views
- 1 replies
- 2 kudos
AUTO CDC SCD Type 2 with late-arriving deletes: edge cases the docs don't cover
Hi everyone,I'm designing a Lakeflow Declarative Pipeline that processes customer profile changes from a CDC feed into an SCD Type 2 Silver table. Events can arrive out of order, sometimes up to 24 hours late. The planned flow:CREATE OR REFRESH STREA...
- 94 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi Liresa,I went through the current docs for these. Two of your three questions have gaps in the documentation, so I'll separate what's documented from what I'd verify.1. Deletes after tombstone expiry. Not documented. The only guidance is the rule ...
- 2 kudos
- 56 Views
- 1 replies
- 0 kudos
Jobs suddenly stopped running with no errors
I have had a few jobs scheduled to run daily since last year. There were no problems for the first 10 months, but on 31 August 2026, the jobs suddenly stopped running, with no errors or messages indicating the cause.I rescheduled the jobs, and they s...
- 56 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Aminsn,I understand the frustration, but "stopped with no errors" is a useful clue. When a job fails, you see red runs. When nothing appears at all, the scheduler didn't try, which usually means the trigger was paused or the run was skipped before...
- 0 kudos
- 43 Views
- 0 replies
- 0 kudos
Zempira: dagelijkse capsules voor darmbalans en gewichtsbeheer
Zempira is een capsulevormig voedingssupplement dat zich richt op de combinatie van darmgezondheid en ondersteuning bij gewichtsbeheer. De formule bevat inuline, aardappelzetmeel en meerdere probioticastammen. Volgens de beschikbare productinformatie...
- 43 Views
- 0 replies
- 0 kudos
- 1317 Views
- 4 replies
- 5 kudos
Resolved! Unity Catalog - How to read prod data in dev with appropriate read-only access?
Hi there,Our team is currently migrating to using Unity Catalog. We have two databricks workspaces for dev & prod, and one thing that I'm wondering is if there is a simple/appropriate way to have only two catalogs dev & prod, where the prod databrick...
- 1317 Views
- 4 replies
- 5 kudos
Latest Reply
- 5 kudos
Yes, we can share prod data into a dev workspace in Unity Catalog with read-only access. Databricks has built this to be remarkably simple without lengthy processes.The only prerequisites are that both workspaces must be in the same region and attach...
- 5 kudos
- 175 Views
- 3 replies
- 4 kudos
Unity Catalog v.2.0?
Are there plans for a v.2.0 of Unity Catalog? I find the organization of tables in databricks to be very constrained and inflexible. Given that UC tables have their origins in data lakes, you would think they would have brought a lot more flexibile...
- 175 Views
- 3 replies
- 4 kudos
Latest Reply
- 4 kudos
Fair points, especially for data coming from systems with richer naming. I can't speak to the roadmap, but here's what works for us today:Aliases: Create views in a consumer-facing catalog, like reporting.sales.outside_sales, that point to the real t...
- 4 kudos
- 206 Views
- 4 replies
- 5 kudos
Best Architecture Approach for Databricks Multi-Cloud and Multi-Region Deployment
I am working on a data platform requirement where we need to support multiple cloud providers and multiple regions using Databricks.For example:AWS – Region 1AWS – Region 2Azure – Region 1Azure – Region 2The requirement is to maintain data processing...
- 206 Views
- 4 replies
- 5 kudos
Latest Reply
- 5 kudos
Hi @Srini_Pesala ,One Databricks workspace per Cloud + Region combination. So you'll have 4 separate workspaces (AWS-R1, AWS-R2, Azure-R1, Azure-R2). They don't share compute or storage directly.How to Handle Each ConcernData Residency Each workspace...
- 5 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1449 | |
| 1253 | |
| 1187 | |
| 961 |
Latest from our Blog
Multi-region model serving on Databricks with OpenSharing
Introduction Enterprises today serve customers across continents, from New York to Singapore, London to São Paulo. For these organizations, delivering fast, reliable user experiences is a business req...
Tutorial: Databricks Genie for Data Engineers and Data Scientists
Note: This blog post is a summary of a Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub. Tutorial: Databricks Genie for Data Engineers and Data Scien...
Beyond the Dashboard: How Transferz Built a Truly Data-Driven Company Culture With AI/BI Genie
Transferz, a fast-growing travel tech platform, eliminated its data team bottleneck by deploying AI/BI Genie — achieving 89,5% adoption across business users achieving 60% operational improvements.Th...
5 Ways to Enhance Databricks AI/BI Dashboard Tables with HTML
Organizations use AI/BI dashboard tables to review accounts, catch problems, and decide what to do next. Yet a plain table can hold all the right data and still be hard to read. One way to improve the...
