cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 
Community Bricktalk | Master Multi-Cloud Data Sharing with OpenSharing & Global Distribution

Hey Databricks Community! Join us for a free community-sponsored BrickTalk where we’ll explore Multi-Cloud Data Sharing with OpenSharing SecureConnect & Global Distribution. BrickTalks is a community event series where Databricks experts share real-w...

  • 393 Views
  • 0 replies
  • 0 kudos
Wednesday
Databricks Advanced Learning Festival: November 10 - December 08 2026

Databricks Advanced Learning Festival November 10 – December 8, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are ...

  • 45870 Views
  • 79 replies
  • 14 kudos
10-08-2026
✈️ 9 Cities, 1 Epic November: The Data + AI World Tour is Here!

NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...

  • 3413 Views
  • 1 replies
  • 1 kudos
3 weeks ago
DATA + AI LIVE | Context Is Just the Beginning: Meet your data smart AI coworker

DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...

  • 2604 Views
  • 0 replies
  • 2 kudos
4 weeks ago
DATA + AI World Tour 2026

REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...

  • 4784 Views
  • 0 replies
  • 4 kudos
09-01-2026
Solution Accelerator Series | Predict Patient Disease Risk & Measure Quality

Predicting patient disease risk and measuring quality of care are important to precision health. This Solution Accelerator demonstrates a machine learning workflow using healthcare data to identify clinical and demographic factors associated with dis...

  • 223 Views
  • 0 replies
  • 0 kudos
Wednesday
🌟 Community Pulse: Your Community Roundup! September 14 – October 11, 2026

Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars   The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...

  • 1139 Views
  • 0 replies
  • 4 kudos
10-15-2026

Community Activity

MandyR
by • Community Manager
  • 4429 Views
  • 5 replies
  • 11 kudos

Resolved! The New Databricks User Groups Platform is here!

We’re excited to introduce Databricks User Groups (usergroups.databricks.com), a dedicated platform built to enhance regional and special‑interest Databricks communities with better organizer tools, easier event management, and more consistent engage...

Screenshot 2026-02-05 at 10.27.50 PM.png
  • 4429 Views
  • 5 replies
  • 11 kudos
Latest Reply
MandyR
Community Manager
  • 11 kudos

Hello there, apologies for the late reply, I have been on leave.  It should be automatic through the user group portal (usergroups.databricks.com) after you host your first event. If they are having trouble, please email usergroups@databricks.com Tha...

  • 11 kudos
4 More Replies
dgr
by > • New Contributor II
  • 62 Views
  • 2 replies
  • 0 kudos

Guidance on resolving Delta Lake concurrency exceptions during parallel writes

Hi everyone,We are new to Databricks and are currently in the process of migrating our ETL workloads from SSIS (SQL Server) to Databricks Delta tables.Coming from a traditional relational database background where row-level locking handles parallel u...

  • 62 Views
  • 2 replies
  • 0 kudos
Latest Reply
Satyasai
Contributor
  • 0 kudos

@dgr 1. Table DesignEnsure that your table structure and design is optimally setup for safe parallel writes.A. Use Deletion Vectors + Row-Level Concurrency (Unpartitioned / Liquid Clustered)Modern Databricks Runtimes (DBR 14.2+) support Row-Level Con...

  • 0 kudos
1 More Replies
snahar
by • Databricks Employee
  • 65 Views
  • 0 replies
  • 1 kudos

Query Performance Insights in action

Query Performance Insights is one of my favorite recent Databricks features. After a slow job run, the hardest part is often knowing where to start. The feature gives me a visual starting point and connects each finding to the relevant query or opera...

snahar_0-1794860441755.png snahar_1-1794860441748.png snahar_2-1794860441748.png snahar_3-1794860441749.png
  • 65 Views
  • 0 replies
  • 1 kudos
Albertino
by > • New Contributor II
  • 795 Views
  • 3 replies
  • 2 kudos

databricks-connect library for python and pandas 3

Hello,databricks-connect is pinning pandas during the installation. Since we're moving towards pandas 3 can you please add the support for the newest version as well?

Data Engineering
databricks-connect
Pandas
python
  • 795 Views
  • 3 replies
  • 2 kudos
Latest Reply
SergejK
Visitor
  • 2 kudos

Hello, is there a timeframe when the pandas 3.0 support will be implemented?

  • 2 kudos
2 More Replies
tabinashabir
by > • New Contributor II
  • 52 Views
  • 1 replies
  • 0 kudos

Zerobus Ingest availability in Azure South Africa North (southafricanorth)?

We are looking at Zerobus Ingest for streaming events directly into Unity Catalog Delta tables, where the delta table is the only consumer. Our Azure Databricks workspace is in South Africa North (southafricanorth), and data residency means we cannot...

  • 52 Views
  • 1 replies
  • 0 kudos
Latest Reply
arthurfr23
New Contributor III
  • 0 kudos

You're right, southafricanorth isn't currently on the Zerobus Ingest regional availability list for Azure. The Zerobus endpoint always runs in your workspace's region, so you can't point clients at an endpoint in another region and still write to you...

  • 0 kudos
Daniel_B
by > • Contributor II
  • 108 Views
  • 1 replies
  • 0 kudos

DevOps Fundamentals: Demo: Deploying the Databricks Project

The course mentions that course material may lag behind the current version of DataBricks.I wonder if the difference between the video in Demo: Deploying the Databricks Project is now too different to what is seen in the Vocareum videos.For example: ...

  • 108 Views
  • 1 replies
  • 0 kudos
Latest Reply
pstyld
Databricks Employee
  • 0 kudos

  Thank you for bringing this to our attention @Daniel_B , and sorry for the confusion. The videos use older terminology, while the lab content in Vocareum is up to date. We will update the videos to align with the current content. To clarify the nam...

  • 0 kudos
Mateus-Moreira
by > • New Contributor II
  • 62 Views
  • 1 replies
  • 1 kudos

Databricks Cost Monitoring: Sharing My SQL Query – Feedback and Suggestions Welcome!

Hi everyone!I've been working on a SQL query to monitor and analyze Databricks usage costs using Unity Catalog system tables.The goal is to consolidate usage information from different workspaces and identify costs by resource, such as Jobs, Apps, SQ...

  • 62 Views
  • 1 replies
  • 1 kudos
Latest Reply
suranga
Databricks Partner
  • 1 kudos

Thanks for sharing this, it's a good base. A few things I'd change:1. The price join can double count. With BETWEEN DATE(price_start_time) AND DATE(price_end_time), usage on the day a price changes matches both the old and the new price row. Joining ...

  • 1 kudos
saurabh18cs
by > • Honored Contributor III
  • 59 Views
  • 1 replies
  • 0 kudos

Clarification Needed on AI/GenAI Billing Origin Products

Hi Databricks Team,On our side, we have a clear separation between analytical platforms and AI platforms, which helps us provision use cases on the appropriate platform.We are now building an overview based on system.billing.usage to identify billed ...

  • 59 Views
  • 1 replies
  • 0 kudos
Latest Reply
suranga
Databricks Partner
  • 0 kudos

I can't speak to the roadmap, but here's what the billable usage reference says today:AGENT_BRICKS: Knowledge Assistant and Supervisor Agent workloadsSUPERVISOR_AGENT: Supervisor Agent workloadsGENIE: pay-as-you-go Genie usageSo Supervisor Agent appe...

  • 0 kudos
Coffee77
by > • Honored Contributor III
  • 70 Views
  • 1 replies
  • 0 kudos

External Access and iFrame Embedding of Dashboards with Private Link and Public Net Access Disabled

Hi Databricks Community,I am looking for recommendations and real-world experiences on how to provide external users with browser-based access to Azure Databricks AI/BI Dashboards, including embedding dashboards in external applications, while keepin...

  • 70 Views
  • 1 replies
  • 0 kudos
Latest Reply
suranga
Databricks Partner
  • 0 kudos

Part of this is answered in the docs, so I'll start there.With public network access disabled, Azure Databricks says all user traffic must come from a VNet connected through a private endpoint. Embedding doesn't change that. With embedding for extern...

  • 0 kudos
MichaelAnckaert
by > • New Contributor
  • 245 Views
  • 5 replies
  • 5 kudos

Issue with CDC ingestion pipeline

Hello everyoneI'm trying to setup an ingestion pipeline from a mysql server and keep running into an issue. The setup was validated and the pipeline created. When I run the pipeline the destination tables are created in the schema, but then the follo...

  • 245 Views
  • 5 replies
  • 5 kudos
Latest Reply
suranga
Databricks Partner
  • 5 kudos

Thanks for checking the staging side. Yes, it could be the issue. An empty bucket in "s3:/" looks like a storage root that resolved to nothing, and Unity Catalog only falls back to the metastore when neither the schema nor the catalog has a managed l...

  • 5 kudos
4 More Replies
DoTA
by > • Honored Contributor
  • 139 Views
  • 1 replies
  • 0 kudos

Protecting Your Company Data When Integrating Coding Agents through Unity AI Gateway

Coding agents like Claude Code, Codex, OpenCode, or PI, started through the ug launcher, and integrated with foundation models through Unity AI Gateway can run with whatever Databricks permissions the developer already has through MCPs that is native...

  • 139 Views
  • 1 replies
  • 0 kudos
Latest Reply
slowder
Contributor
  • 0 kudos

The SQL policy for blocking private keys is a strong starting point. To make these rules easier to manage, it helps to clarify ownership: defining what counts as an unapproved credential or sensitive token often involves both security and platform en...

  • 0 kudos
inaafina
by > • Visitor
  • 114 Views
  • 2 replies
  • 0 kudos

Overwrite Job Errors

I keep on getting this error message when trying to create a parquet in my notebook. Has anyone found this error too? My overwrite path was working perfectly fine before.SparkConnectGrpcException: (java.lang.IllegalStateException) operationId: d5871d...

  • 114 Views
  • 2 replies
  • 0 kudos
Latest Reply
saurabh18cs
Honored Contributor III
  • 0 kudos

Hi  @inaafina setup like this , this is a new way to automatically resolve right package versions based on your compute. you have to use databricks cli  e.g. databricks environments setup-local \ --serverless-version 5 \ --dry-run

  • 0 kudos
1 More Replies
Tushar_Parekar
by • Community Manager
  • 84 Views
  • 0 replies
  • 0 kudos

CUSTOMER STORY | KaBuM! Accelerates AI Innovation on Databricks

“Databricks helped KaBuM! accelerate innovation and democratize access to data and AI, transforming complex analyses into agile decisions.” - Pablo Henrique de Freitas, Data and AI Manager, KaBuM! KaBuM!, Latin America’s largest technology and gaming...

Kabum.png
  • 84 Views
  • 0 replies
  • 0 kudos
DSBDatabricks
by • Databricks Employee
  • 176 Views
  • 1 replies
  • 0 kudos

Databricks and SAP: Building the Next Generation of Enterprise Data and Analytics

Join experts for an update on the Databricks–SAP partnership and how SAP Business Data Cloud can help organizations modernize their data and analytics architecture. We’ll explore the latest platform capabilities, roadmap direction, and the considerat...

Databricks Skill Builder cover
  • 176 Views
  • 1 replies
  • 0 kudos
Latest Reply
DmitryKuznetsov
New Contributor II
  • 0 kudos

@Qi_Su, I guess this one needs a slight update after latest announcements? Link below https://youtu.be/PvSU8FyNcwA?t=3346&si=4joQf-Cczqrb2Ilj

  • 0 kudos
DmitryKuznetsov
by > • New Contributor II
  • 60 Views
  • 0 replies
  • 0 kudos

Parameterised metric views in Excel: what the Databricks Add-in can and can't do (Nov 2026)

Parameterised metric views in Excel: what the Databricks Excel Add-in can and can't do today (Nov 2026)Drafted with AI assistance. Every result below was reproduced by hand on 2026-11-16 and checked against plain SQL on samples.tpch.orders.TL;DRI tes...

s0-decision-flow.png s8-view-definition.png s1-pivot-builder.png s2-pivot-result.png
  • 60 Views
  • 0 replies
  • 0 kudos
Welcome to the Databricks Community!

Once you are logged in, you will be ready to post content, ask questions, participate in discussions, earn badges, and more.

Spend a few minutes exploring Get Started Resources, Learning Paths, Certifications, and Platform Discussions.

Join Learning Events here in the Community.

Connect with peers through Databricks User Groups and learn more about Community Events happening near you. We’re excited to see you get involved.

Top Kudoed Authors

Latest from our Blog

Level Up Your Genie Agent with Unstructured Files

Going Beyond Structured Data Genie Agents have always answered questions about your structured data, including tables, views, and metric views. Now they can also analyze files in volumes, such as PDF ...

181Views 0kudos

How to Query Unity Catalog Views from External Engines

Summary External engines can now query Unity Catalog views. Views over Delta tables are served through the Unity REST API (Generally Available). Views over Iceberg tables are served through the Iceber...

632Views 0kudos