The Genie has spoken And the winners of the Genie-Powered App Challenge are… A few weeks ago, we threw down a challenge: build something incredible with Databricks Apps and Genie Agent. And wow, you delivered. From smart, real-world prob...
- 1144 Views
- 9 replies
- 7 kudos
Thursday
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, September 17, 2026! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with d...
- 471 Views
- 0 replies
- 2 kudos
a week ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 811 Views
- 0 replies
- 3 kudos
2 weeks ago
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 62458 Views
- 90 replies
- 43 kudos
4 weeks ago
Virtual Event Time: AMER Sept 23 / 9 AM PTEMEA Sept 24 / 9 AM BST / 10 AM CESTAPJ Sept 24 / 9:30 AM IST / 12 PM SGT / 1 PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: Marking RSVP on this Community ...
- 684 Views
- 0 replies
- 2 kudos
2 weeks ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 2875 Views
- 0 replies
- 3 kudos
08-11-2026
Community Champion • Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individ...
- 254 Views
- 5 replies
- 5 kudos
yesterday
Product onboarding can be complex and time-consuming when teams work with inconsistent data formats, inaccurate information and multiple stakeholders. The Simplifying Product Onboarding With Generative AI Solution Accelerator shows how generative AI ...
- 200 Views
- 0 replies
- 0 kudos
a week ago
The Weekly Digest • August 31 – September 6 Community Pulse Your weekly pulse: new articles, real answers, and the discussions worth watching. This Week's Community Stars This week's difference-makers – and a shout-out to the new members ear...
- 430 Views
- 1 replies
- 2 kudos
a week ago
Community Activity
- 6 Views
- 0 replies
- 0 kudos
Notebook commands hang after restarting a cluster with custom library installed
Hi,I'm experiencing an issue with a Databricks notebook after restarting a cluster that has a custom library installed.Here are the steps I followed:Created a Databricks compute cluster.Attached a notebook to the cluster.Installed a library required ...
- 6 Views
- 0 replies
- 0 kudos
- 20 Views
- 1 replies
- 1 kudos
ODBC setup
Greetings!I am just starting with databricks. I created an account, and I can run sql queries.I downloaded the ODBC driver (64bit version). I am not sure how to set it up. The configuration screen shows "Mechanism" set to "User Name and Password."The...
- 20 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
This is the screen:
- 1 kudos
- 31 Views
- 0 replies
- 0 kudos
Databricks architecture drawn step by step: control plane, compute plane, Delta, Unity Catalog
I kept getting the same interview question, "explain the Databricks architecture", and most answers are a wall of text. So I drew it.The crisp answer: Databricks manages the control plane (web app, job scheduler, notebook metadata). Your compute runs...
- 31 Views
- 0 replies
- 0 kudos
- 710 Views
- 2 replies
- 2 kudos
Solution Accelerator Series | Toxicity Detection in Gaming
Build Healthier Communities With Real-Time AI! This Solution Accelerator helps you detect toxic in-game chat in real time so you can protect players, reduce churn and keep your gaming communities engaged and healthy. It shows you how to use a lakehou...
- 710 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
A strong use of AI for creating safer gaming communities. Real-time toxicity detection can improve player interactions, strengthen moderation, and support better retention while helping teams build healthier digital experiences.
- 2 kudos
- 1342 Views
- 10 replies
- 1 kudos
Unable to Enable Unity Catalog – Azure Managed Identity Credential Not Found
Hi Databricks Community,I am trying to enable Unity Catalog in my Azure Databricks account. As part of the setup, I created an Azure Databricks Access Connector and assigned its managed identity the required permissions on my ADLS Gen2 storage accoun...
- 1342 Views
- 10 replies
- 1 kudos
Latest Reply
- 1 kudos
I hit the same error.When creating a Unity Catalog metastore from the web UI of the Azure Databricks Account Console, the following error appeared during Access Connector validation, despite having all the Azure configuration correctly set up (manage...
- 1 kudos
- 62 Views
- 0 replies
- 0 kudos
Announcement | A practical approach to end-to-end Solvency II reporting in Databricks
Solvency II is more than a regulatory submission. It connects data ingestion, reserving, capital calculation, QRTs, the ORSA, governance, approvals, and disclosure. The EU framework brings quantitative requirements, governance and risk management, an...
- 62 Views
- 0 replies
- 0 kudos
- 85 Views
- 3 replies
- 0 kudos
Lakeflow connect CT pipeline keeps running multiple connections in source
I'm working on an ingestion pipeline. I was adding tables to it gradually so that we can monitor the load on our prod server side by side and with my last set of tables added (with them, all the heavy duty tables were inside that pipeline), the load ...
- 85 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
For a standard connector, the gateway continuously extracts snapshots, change logs, and metadata, while a separately scheduled serverless pipeline applies staged data (connector components). Changing the serverless pipeline schedule therefore does no...
- 0 kudos
- 7420 Views
- 7 replies
- 6 kudos
Resolved! Customer Academy Labs for Self Paced
I was told by someone you could do labs in the self paced part of the databricks academy. Right now I am on Demo: Creating and Working with a Delta Table in the Get Started with Databricks for Data Engineering course and I see no link to a lab anywh...
- 7420 Views
- 7 replies
- 6 kudos
Latest Reply
- 6 kudos
I am in the process of completing the Data Bricks Getting Started with Data Engineering (free) course. I am at the stage in the self-paced video labeled Demo:Creating and Working with a Delta Table is demonstrated. The video demonstration eludes to u...
- 6 kudos
- 76 Views
- 0 replies
- 0 kudos
Announcement | Unifying governance across engines and catalogs in the Open Lakehouse
Open table formats make data portable. The next challenge is making governance just as portable. Two additions to the Apache Iceberg REST Catalog help address that challenge: read restrictions for delegated enforcement and catalog labels for portable...
- 76 Views
- 0 replies
- 0 kudos
- 61 Views
- 1 replies
- 1 kudos
UC Delta API: managed-table READ_WRITE credentials rejected despite explicit User-Agent
Hi everyone,I’m developing HarborSQL, an open-source SQL engine using Apache DataFusion and delta-rs. I’m working on managed Delta table writes through the UC Delta API with catalog commits.Using the same workspace, managed table, and user identity:-...
- 61 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @ablanchard .The behavior you're seeing is expected for the Delta protocol-level credential endpoint (/api/2.1/unity-catalog/delta/v1/.../credentials). A few things to note:Managed Delta table writes from external Delta clients are in Public Previ...
- 1 kudos
- 118 Views
- 3 replies
- 4 kudos
Feature enablement for Foundation Model Unity Catalog permissions
I am trying to restrict workspace users' access to Databricks Foundation Models using the guidance in the Foundation Model Unity Catalog Permissions documentation.I have revoked EXECUTE permission for all users from the system.ai schema. However, wor...
- 118 Views
- 3 replies
- 4 kudos
Latest Reply
- 4 kudos
It persists after enablement. The legacy databricks-* endpoints are a separate serving path from both pay-per-token and provisioned throughput, so they aren't gated by the system.ai EXECUTE revoke. It isn't pre-enablement behaviour that clears once t...
- 4 kudos
- 254 Views
- 5 replies
- 15 kudos
Databricks Community Champion - August 2026 - Shamen Paris
Community Champion • Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individ...
- 254 Views
- 5 replies
- 15 kudos
- 96 Views
- 2 replies
- 2 kudos
Resolved! ConcurrentAppendException on parallel MERGE into the same Delta table, despite disjoint keys
Hi everyone, Hoping someone has been through this, because I am running out of ideas. Setup. DBR 15.4 LTS, Unity Catalog managed Delta table, roughly 900 million rows. Six upstream sources each write into the same target table through their own job, ...
- 96 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @Islam_hoti This is a classic "Optimistic Concurrency Control" bottleneck in Delta Lake. Even with partitions, the MERGE operation requires a metadata-level lock on the table's transaction log, which is where your contention is happening.Here is a...
- 2 kudos
- 47 Views
- 0 replies
- 0 kudos
A Metadata-Driven Backdated Extraction Pattern for IoT/Sensor Pipelines Using Zerobus and Databricks
IntroductionIoT devices generate a large amount of data every day. In a perfect scenario, all this data arrives on time and our ingestion pipeline processes it using incremental loads. But in real-world IoT systems, this does not always happen.A devi...
- 47 Views
- 0 replies
- 0 kudos
- 53 Views
- 0 replies
- 0 kudos
Solution Accelerator Series | Customer Entity Resolution
Building a customer 360 requires connecting customer records across disparate data sets and establishing common customer identities. The Customer Entity Resolution Solution Accelerator shows how to build that foundation by translating customer attrib...
- 53 Views
- 0 replies
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1412 | |
| 1253 | |
| 1186 | |
| 961 |
Latest from our Blog
Tutorial: Transform your Lakeflow Connect ad data into visual and conversational analytics
Introduction Traditionally, unifying requires building brittle custom integrations for every single source. Lakeflow Connect resolves this with native, fully managed connectors for a full suite of mar...
Meet SDP Rewind: An undo button for your ETL pipelines
A bad deployment slips into your pipeline on Friday, and by Monday, it has been writing incorrect data for three days, with no clean way to roll it back. You can restore one table, but a pipeline is a...
Actually understanding Unity Catalog Managed Tables
The “why” worth knowing Choosing external tables is usually about flexibility: you keep dedicated storage, maintain raw files that multiple engines can query directly, and control your own partitionin...
Introducing Stream-Stream Join Support in Apache Spark Real-Time Mode
Summary Explore how Real-Time Mode for Apache Spark Structured Streaming on Databricks now supports inner stream-stream joins in update mode — with sub-second latency.See it in action on a real-time a...
