Welcome to the family 2,800 new members.And counting. DAIS 2026 brought a wave of new faces to the Databricks Community. If you just joined, welcome. This post is for you: what just happened, what Community is, and what you can do here. What...
- 202 Views
- 0 replies
- 3 kudos
14 hours ago
Grow Your Skills and Earn Rewards! Mark your calendar: June 15 – July 6, 2026 Join us for a three-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whethe...
- 120533 Views
- 269 replies
- 101 kudos
05-14-2026
Join Our Business Impact Accelerator Sessions! We are thrilled to invite you to the Business Impact Accelerator, a specialized single-session program designed specifically for business professionals, executives, and non-technical teams. If yo...
- 1426 Views
- 1 replies
- 3 kudos
3 weeks ago
Learn how the lakebase architecture decouples compute from storage, so you can build, ship and run agents and apps faster. Databricks has introduced a new category of serverless Postgres database built to integrate seamlessly with your lakehouse sta...
- 1027 Views
- 0 replies
- 0 kudos
2 weeks ago
Brand imagery plays an important role in how retail companies express their identity and connect with customers. The Creating Brand-Aligned Images Using Generative AI Solution Accelerator shows how organizations can use generative AI to interpret ele...
- 152 Views
- 0 replies
- 1 kudos
yesterday
The Weekly Digest • June 15 – June 21 Community Pulse DAIS was electric – and the community didn't hold back.Fair warning: this edition came out extra vibrant, DAIS had that effect on us. This Week's Community Stars A warm welcome to our newes...
- 207 Views
- 3 replies
- 4 kudos
yesterday
Community Activity
- 29 Views
- 1 replies
- 0 kudos
Is there a way to deactivate genie auto corretion
Genie keeps breaking my code, sometimes making almost impossible to write code.Sometimes it behaves in a normal way, but sometimes it auto correts at every moment, with non wanted code.There is any way to fix it? I know its a bug, but i also dont kno...
- 29 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
I already deactivated alll genie features in the developer settings but it keep breaking my code and the flow...
- 0 kudos
- 33 Views
- 0 replies
- 0 kudos
Databricks goes full-stack
Fast reads and fast writes, thanks to Lakebase, including writes to open formats. It creates a unified platform both for analytics and operational use cases. #databricks #DataAISummit https://databrickster.medium.com/my-favorite-announcements-from-th...
- 33 Views
- 0 replies
- 0 kudos
- 41 Views
- 1 replies
- 0 kudos
Views in DR environment
Hi Team,We are currently using the Databricks Deep clone feature to clone our tables to Databricks DR environment. When we deploy our jobs, they run in production and the tables get cloned to the DR. But the views dont get cloned as deepclone doesnt ...
- 41 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @DineshOjha, This is expected behaviour. DEEP CLONE is designed for tables, so it works well for keeping Delta tables in sync to a DR environment. The public docs describe clone as creating a copy of a source table at a specific version, and they ...
- 0 kudos
- 46 Views
- 1 replies
- 0 kudos
AI Extract is disabled?
Why is AI Extract is not loading up? im on azure databricks and i have JPEG images in a Databricks Volume. Its on GA but why is it asking to contact sales for this?
- 46 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @suranga, I have checked this internally. What you're seeing is most likely a workspace availability issue rather than a problem with JPEG files in a Unity Catalog Volume. The public Information Extraction documentation lists a few workspace prere...
- 0 kudos
- 67 Views
- 1 replies
- 0 kudos
Spark UI Troubleshooting: Data Skew vs Cluster Resource Bottlenecks
How can Spark UI metrics be used to distinguish data skew from insufficient cluster resources?When a Databricks job is slow, we usually look at Spark UI metrics such as task duration, shuffle read/write, spilled bytes, GC time, executor CPU utilizati...
- 67 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Dhivyadharshini, Your question prompted me to write a blog post about it, so thank you for asking. Here is the sequence I follow: Stages tab, sort by Duration descending. Pick the longest stage and click into it. Everything else is noise until yo...
- 0 kudos
- 29 Views
- 0 replies
- 0 kudos
Account does not exists error
I am writing to request assistance with a login issue I am experiencing with Databricks.I am attempting to create a Databricks account on AWS using my email address. Although I already have an active AWS account associated with this email, I am unabl...
- 29 Views
- 0 replies
- 0 kudos
- 38 Views
- 0 replies
- 0 kudos
Reading Spark UI: A Repeatable Guide to Finding Performance Bottlenecks
A question came up in the community recently that I thought deserved more than a short answer. The question was around how to build a reliable investigation sequence for slow Spark jobs, specifically when symptoms overlap. A long-running stage with ...
- 38 Views
- 0 replies
- 0 kudos
- 60 Views
- 2 replies
- 1 kudos
Accessing Document Presented in Demo in Get Started with AI Agents on Databricks Course
I'm taking Get Started with AI Agents on Databricks Course and cannot find the document that is shown in the Demo section.I wonder whether the Demo is for a show only or the learner can follow along. If the latter, where can I find it?Course Link: ht...
- 60 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @3R1, Thank you for flagging this! The document shown in the Demo section of the Get Started with AI Agents on Databricks course is a Databricks Notebook. You should be able to access it by following the steps below: Log in to Databricks Academy...
- 1 kudos
- 5016 Views
- 2 replies
- 0 kudos
Data Migration from SAP S/4HANA to Databricks
May someone please help me designing the Migration of SAP S/4 HANA to Databricks. How to design this. what all we need to consider as LLD.1. How Data needs to be extracted and by which tool ? near–real-time replication is required2. Each layer for Da...
- 5016 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Pratikmsbsvm, Here is an updated view of the options for moving SAP S/4HANA data into Databricks, including the SAP and Databricks partnership path that is now the recommended low-friction approach. I will cover the integration options first, the...
- 0 kudos
- 239 Views
- 2 replies
- 2 kudos
Resolved! Managing IPYNB cell timestamps in source control
We're in the process of converting over our Databricks notebooks from .py file to .ipynb. We have disabled storing notebook output in source control at the workspace level.However, what we're discovering is that every cell in our notebooks has 3 time...
- 239 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @emorgoch, Thanks for raising this. This appears to be a regression rather than expected behaviour. Internally, the issue has been identified around .ipynb handling in Git folders, and the intended fix is to stop serialising these execution timest...
- 2 kudos
- 38 Views
- 0 replies
- 0 kudos
Fortifying Enterprise Healthcare Databricks Lakebase with the Security Triad
Modern Enterprise Healthcare Lake bases have fundamentally transformed care data operations by seamlessly unifying high concurrency transactional workloads such as electronic records (EMR) syncing, streaming care vitals and persistent memory for gene...
- 38 Views
- 0 replies
- 0 kudos
- 141 Views
- 3 replies
- 0 kudos
DLT pipelines failing out of memory (serverless)
I have a Data Lake Transformation (DLT) pipeline that runs weekly. Normally, it takes 8 minutes to complete, but since last Friday (June 19), it has been running for hours until it encounters an out-of-memory error. This pipeline is responsible for c...
- 141 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
I think this is more like an incremental refresh issue than a generic serverless memory issue.Since the pipeline completes in around 20 minutes with a full refresh, but the normal weekly run runs for hours and then fails with OOM, I would first recom...
- 0 kudos
- 1116 Views
- 4 replies
- 2 kudos
Resolved! NetSuite JDBC Driver 8.10.184.0 Suppor
Hello,I am currently attempting to integrate NetSuite with Databricks using the NetSuite JDBC driver version 8.10.184.0. When I attempt to ingestion information from NetSuite to Databricks, I find that the job fails with a checksum error and informs ...
- 1116 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @b_pinter, The NetSuite JDBC driver version 8.10.184.0 is indeed supported by Databricks for managed ingestion via Lakeflow Connect. The officially supported driver versions are 8.10.147.0, 8.10.170.0, and 8.10.184.0. The "JAR checksum does not ma...
- 2 kudos
- 509 Views
- 3 replies
- 0 kudos
system.ai.python_exec suddenly failing with UNRESOLVED_ROUTINE on Azure (West US) since May 27 ~4pm
Hi all, We're hitting a sudden failure with Databrick's built-in python sandbox system.ai.python_exec function and want to check whether others are seeing the same thing, since it looks region-specific.Environment:Cloud: Azure DatabricksRegion: West ...
- 509 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi, I've just tested it on my environment, and it works fine. My initial suggestion would be to restart the compute you're trying it on/test other compute types, and if that doesn't work, then to file a ticket with our support teams. Thanks,Emma
- 0 kudos
- 51 Views
- 1 replies
- 0 kudos
How to share history of streaming table with Open Sharing?
Databricks has limitations when using Open sharing that history of Streaming tables cannot be shared.What are the best 'workarounds'? How to provide history to the recipient?
- 51 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
You can follow belowShare Standard Delta Table - Instead of sharing the streaming table directly, share a regular Delta table with history that captures the same data. You can create a standard Delta table from the streaming source and share it WITH ...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2275 | |
| 1322 | |
| 1231 | |
| 1182 | |
| 960 |
| User | Count |
|---|---|
| 442 | |
| 286 | |
| 220 | |
| 63 | |
| 51 |
Latest from our Blog
Features in Motion: Three Patterns for Real-Time ML in Databricks Lakebase
Summary In production machine learning systems (like real-time recommenders or fraud detection), models operate under a strict latency budget (typically milliseconds end-to-end). Within this window, t...
Incremental REPLACE WHERE Flows Brings Targeted Refreshes to SDP and DBSQL
Lakeflow Spark Declarative Pipelines (SDP) has long supported two ways to maintain a table: a streaming flow for incremental ingestion and a materialized view for a fully derived result that is always...
One question, two data realities: supervisor agents across Kafka and the lakehouse
The setup every operations analyst knows A procurement lead asks what sounds like a simple question:"Of the orders that came in over the last hour, which ones are from customers who are close to their...
Triggering Databricks Jobs from Celonis Action Flows — A Step-by-Step Guide
Turn process intelligence into automated action: connect Celonis directly to Databricks. Why Connect Celonis Action Flows to Databricks? Celonis shows you where your business processes break down — wh...
