FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...
- 248 Views
- 1 replies
- 1 kudos
Wednesday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 1231 Views
- 0 replies
- 3 kudos
4 weeks ago
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 156094 Views
- 246 replies
- 73 kudos
08-21-2026
Virtual Event Time: AMER Sept 23 / 9 AM PTEMEA Sept 24 / 9 AM BST / 10 AM CESTAPJ Sept 24 / 9:30 AM IST / 12 PM SGT / 1 PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: Marking RSVP on this Community ...
- 1078 Views
- 0 replies
- 2 kudos
3 weeks ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 3575 Views
- 0 replies
- 3 kudos
08-11-2026
Community Champion • Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individ...
- 844 Views
- 6 replies
- 7 kudos
2 weeks ago
Public sector agencies need well-informed decisions to support the livelihood and security of citizens. The Entity Resolution for Public Sector Solution Accelerator shows how entity resolution can connect disparate data sources, reveal relationships ...
- 192 Views
- 0 replies
- 0 kudos
Wednesday
The Weekly Digest • September 7 – September 13 Community Pulse A new week, a fresh wave of articles, answers, and discussions. Here's your weekly catch-up. This Week's Community Stars The members who showed up and made a difference this week ...
- 349 Views
- 0 replies
- 4 kudos
a week ago
Community Activity
- 73 Views
- 4 replies
- 2 kudos
DeepSeek V4.1 Flash returns workspace ITPM rate-limit error on fresh/idle workspace
Hi, I am unable to use the Databricks-hosted DeepSeek V4.1 Flash model. Even a minimal prompt such as "hi" immediately fails with: REQUEST_LIMIT_EXCEEDED: Exceeded workspace input tokens per minute rate limit for databricks-deepseek-v4-1-flash. Pleas...
- 73 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
@Universeb could you add your cloud, region and workspace tier, please? The published rate limits depend on the tier, so they don't establish your workspace's assigned quota.For one failed REST call, please include the UTC timestamp, any request ID, ...
- 2 kudos
- 57 Views
- 1 replies
- 1 kudos
Best Architecture Approach for Databricks Multi-Cloud and Multi-Region Deployment
I am working on a data platform requirement where we need to support multiple cloud providers and multiple regions using Databricks.For example:AWS – Region 1AWS – Region 2Azure – Region 1Azure – Region 2The requirement is to maintain data processing...
- 57 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
@Srini_Pesala I'd keep processing and storage regional, with a Unity Catalog metastore per cloud/region. Use Databricks-to-Databricks OpenSharing for cross-region access where residency requirements permit.Keep DR separate: managed DR pairs workspace...
- 1 kudos
- 50 Views
- 1 replies
- 2 kudos
Genie One Foundations: What Data Teams Should Get Right Before Rolling It Out
Hi everyone Genie One has been getting a lot of attention since DAIS, and most of the discussion is about what business users can do with it. I want to focus on the other side: what data teams need in place so it gives trustworthy answers.Quick recap...
- 50 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Thanks, @LiresaFerizaj, appreciate your efforts! I'd add one step to the weekly review: turn recurring mistakes into regression tests, then rerun them whenever metric definitions, table descriptions or agent instructions change.For a Genie Agent, the...
- 2 kudos
- 217 Views
- 6 replies
- 6 kudos
Resolved! Genie Higher Environment deployment using DAB
Hi Team,I have successfully developed and tested the Genie in the development workspace environment. I now need to deploy the same Genie to higher environments, such as QA and Production, using the CI/CD process through DAB.Could someone please share...
- 217 Views
- 6 replies
- 6 kudos
Latest Reply
- 6 kudos
@karuppusamy one practical addition to @Ashwin_DSA CLI steps: I'd explicitly separent_path on the genie_spaces resource to an existing workspace folder outside the Git folder, writable by your deployment identity.These two paths serve different purpo...
- 6 kudos
- 45 Views
- 0 replies
- 0 kudos
Open-source app on Databricks system tables - looking for people to build it with me
Hi,I have been working with Databricks for a while and I kept rebuilding the same cost checks on system tables. I put them into a small open-source Streamlit app: spend, avoidable cost, and what to fix, from billing, access, compute, lakeflow, and qu...
- 45 Views
- 0 replies
- 0 kudos
- 79 Views
- 3 replies
- 2 kudos
org.apache.iceberg.connect.IcebergSinkConnector to sink data from kafka to databricks - large volume
Hey.We have different number of topics per let's call it "subject". The connector works great for us if there are not so many topics (partitions) in subject. We have issue when we try to sink 1500 topics, 3 partitions each. We've sharded the topics i...
- 79 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
@dawidch, there is a related upstream ticket: Apache Iceberg #15852, covering scheduled refresh of credentials held by ADLSFileIO. The proposed implementation is still open. I'd treat it as a lead, not yet a confirmed match for your connector versio...
- 2 kudos
- 687 Views
- 1 replies
- 2 kudos
Tutorial: Databricks Genie for Data Engineers and Data Scientists
Note: This blog post is a summary of a Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub. Tutorial: Databricks Genie for Data Engineers and Data Scientists “Take a quick look at the data and assess ho...
- 687 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Thanks for putting this together, @DataAlchemist28. I particularly liked the distinction between a broken sensor and an unusual flight. Keeping that judgment with the engineer is an important detail
- 2 kudos
- 514 Views
- 2 replies
- 3 kudos
Multi-region model serving on Databricks with OpenSharing
Introduction Enterprises today serve customers across continents, from New York to Singapore, London to São Paulo. For these organizations, delivering fast, reliable user experiences is a business requirement: latency can directly impact conversion r...
- 514 Views
- 2 replies
- 3 kudos
Latest Reply
- 3 kudos
Thanks @ivanvyd , glad you found it useful! Great question. Failover leans mostly on endpoint health checks, not a built-in "feature staleness" cutoff, so it's worth adding your own. Two things help: the recipient's synced table keeps serving its las...
- 3 kudos
- 151 Views
- 2 replies
- 0 kudos
Both Databricks Apps Returning 502 Bad Gateway
I am experiencing an issue with both of my Databricks Apps. Both applications are currently unavailable and are returning the same 502 Bad Gateway error.This is affecting both applications, so I would appreciate it if you could investigate whether th...
- 151 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Thank you for the detailed guidance. The issue has been resolved, and both applications are now working fine.My assumption is that the issue was related to the application authentication check. The apps are now working independently without requiring...
- 0 kudos
- 59 Views
- 0 replies
- 0 kudos
Declaring a Primary Key RELY turned my dbt unique Test Green on Duplicate Data
An open dbt-databricks feature request, #1271, asks for native RELY support on primary keys and suggests that rely: true "implicitly create the not_null and unique constraints" as "a safeguard against incorrect query results". Databricks does not enf...
- 59 Views
- 0 replies
- 0 kudos
- 41 Views
- 1 replies
- 0 kudos
CIF architecture diagram inconsistent with the description
Hello, I am unsure if this is the right place to report this, but here it goes.In the course "Data Modeling Strategies", lesson "1.3 Lecture - Inmon's Corporate Information Factory", it seems to me that the description for the CIF architecture diagra...
- 41 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Also, the details state that "The dashed arrow from Operational Sources to ODS is intentional: the Operational Data Store is fed directly from source, bypassing the EDW, to serve near-real-time dashboards that cannot wait for the full ETL cycle."
- 0 kudos
- 248 Views
- 1 replies
- 1 kudos
Level Up Your Databricks Skills: Learning Paths & Free Live Training
FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...
- 248 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
It's great to see Databricks offering so many ways to get started and keep learning, whether you prefer going at your own pace or joining a live session. Thanks for making these resources easy to find, @Tushar_Parekar
- 1 kudos
- 41 Views
- 0 replies
- 1 kudos
Learn Databricks AI Agents | Build, Deploy & Evaluate on Databricks Platform
Databricks Training & Certifications Learn Databricks AI Agents Systems that reason, call tools, and take action - built on the Databricks Platform. Agentic AI Mosaic AI & Agent Bricks 易 Persistent memory AI agents...
- 41 Views
- 0 replies
- 1 kudos
- 210 Views
- 6 replies
- 0 kudos
Resolved! How to override ABAC policies
I'm struggling with the best way to handle ABAC inheritance. Here's the situation:We have tags deployed in table columns across a dozen catalogs and their schemas. In general, certain tags should have column masking policies applied so that our user ...
- 210 Views
- 6 replies
- 0 kudos
Latest Reply
- 0 kudos
The scalable way to handle this is to keep the catalog-level policy, but use a governed tag and a WHEN condition to carve out the schema-level exception.You don't need to remove the catalog-level policy or add "Privileged Users" to the catalog-level ...
- 0 kudos
- 115 Views
- 1 replies
- 0 kudos
Unity Catalog v.2.0?
Are there plans for a v.2.0 of Unity Catalog? I find the organization of tables in databricks to be very constrained and inflexible. Given that UC tables have their origins in data lakes, you would think they would have brought a lot more flexibile...
- 115 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Given the lack of flexibility in the naming of schema and tables, I decided to fall back on external volumes. NOTE: I will not use these external volumes for any of the structured tables in the gold/presentation layer (even though I really dislike t...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1446 | |
| 1253 | |
| 1187 | |
| 961 |
Latest from our Blog
Multi-region model serving on Databricks with OpenSharing
Introduction Enterprises today serve customers across continents, from New York to Singapore, London to São Paulo. For these organizations, delivering fast, reliable user experiences is a business req...
Tutorial: Databricks Genie for Data Engineers and Data Scientists
Note: This blog post is a summary of a Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub. Tutorial: Databricks Genie for Data Engineers and Data Scien...
Beyond the Dashboard: How Transferz Built a Truly Data-Driven Company Culture With AI/BI Genie
Transferz, a fast-growing travel tech platform, eliminated its data team bottleneck by deploying AI/BI Genie — achieving 89,5% adoption across business users achieving 60% operational improvements.Th...
5 Ways to Enhance Databricks AI/BI Dashboard Tables with HTML
Organizations use AI/BI dashboard tables to review accounts, catch problems, and decide what to do next. Yet a plain table can hold all the right data and still be hard to read. One way to improve the...
