We’re getting ready to pilot the Databricks Detective Series ahead of its launch at Data + AI Summit 2026, and we’re looking for Community members to help test it. Databricks Detective Series is a free, gamified, hands-on experience where you become...
- 758 Views
- 8 replies
- 7 kudos
a week ago
We promised something special and here it is. We're thrilled to introduce the DAIS 2026 Community Virtual Challenge, open to every member of the Databricks Community, wherever you are in the world. Opens: May 15, 2026 Closes: May 31, 2026 Winners...
- 901 Views
- 5 replies
- 6 kudos
a week ago
Calling all builders!Since GA, thousands of teams have moved production workloads onto Lakebase. We want to hear how you’re using it.A few examples of stories we’d love to capture: Building stateful AI agents that need persistent memory alongside lak...
- 568 Views
- 9 replies
- 1 kudos
a week ago
Already registered for Data + AI Summit 2026? Join us on Monday, June 15 for the Databricks Apps & Agents for Good Hackathon 2026, hosted in partnership with OpenAI. Secure your spot and apply by Sunday May, 31 Note: Marking RSVP on this Community ...
- 316 Views
- 0 replies
- 1 kudos
a week ago
DAIS 2026 · Speaker Spotlight A conversationwith Surya Sai Turaga On how Ensemble Health Partners turned 800TB of fragmented revenue cycle data into an AI-ready foundation on Databricks Lakebase — and the agentic-AI playbook for healthcare. ...
- 32 Views
- 0 replies
- 1 kudos
6 hours ago
Limited seats are available to join our revamped training program at Data + AI Summit 2026 in San Francisco, with early-bird pricing that gives you 50% off training if you register by April 30. Key highlights Big savings on training and certification...
- 1646 Views
- 3 replies
- 5 kudos
04-21-2026
Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individuals whose passion fo...
- 1638 Views
- 6 replies
- 7 kudos
Wednesday
In today’s media landscape, it can be difficult to know which marketing channels are driving results. The Media Mix Modeling (MMM) Solution Accelerator helps organizations bring together data from channels such as TV, social media and email marketing...
- 135 Views
- 0 replies
- 0 kudos
Tuesday
The Weekly Digest • May 11 – May 17 Community Pulse Catch up on the week's best discussions, articles, and announcements -- fast. Top Contributors This Week Contributors leading with curiosity and kindness: @KrisJohannesen @Sumit_7 @amirabe...
- 110 Views
- 1 replies
- 3 kudos
yesterday
Community Activity
- 4 Views
- 0 replies
- 0 kudos
Do You Still Need a Separate Cloud Data Warehouse? Building an Open Lakehouse for High Performance
You likely maintain at least two separate copies of your crucial data. One resides in your data lake, serving as the source for pipeline writes, ML model training, and engineer debugging. The other is in a cloud data warehouse, which powers dashboard...
- 4 Views
- 0 replies
- 0 kudos
- 11 Views
- 0 replies
- 0 kudos
[PARTNER BLOG] 847 Models, 12 Weeks, 77% Less: Inside R1's Snowflake-to-Databricks Migration
R1 is a leading provider of revenue management solutions for healthcare organizations, supporting hospitals, health systems, and physician groups across front-, middle-, and back-office revenue operations. Through its Phare Revenue Operating System, ...
- 11 Views
- 0 replies
- 0 kudos
- 11 Views
- 0 replies
- 0 kudos
Genie Agent Mode Visibility vs Standard Mode Monitoring
In standard Genie Space chat, space managers can use the Monitoring tab to review prompts/conversations. However, in Agent Mode, we see the warning:“Genie agent responses may contain results obtained using other users’ credentials and are hidden from...
- 11 Views
- 0 replies
- 0 kudos
- 89 Views
- 3 replies
- 0 kudos
Inconsistent Cluster Log Persistence to Volume/S3 (stderr, stdout, log4j-active.log)
Saving logs from an all-purpose cluster to Volume or S3 is not consistent, because stderr, stdout, and log4j-active.log get overwritten when the cluster is restarted between minutes 01 and 59.Tested case:A job is configured to start every 20 minutes,...
- 89 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @ccsalt , This is a known limitation. Log rotation (renaming to log4j-YYYY-MM-DD-HH.log.gz) only happens on the hour boundary. The active log file log4j-active.log has always the same name and is overwritten if a cluster restart happens within one...
- 0 kudos
- 18 Views
- 1 replies
- 0 kudos
Merge Conflicts During Concurrent Delta Table Updates
I have a requirement where I need to run multiple concurrent runs on a particular table, however some merges fail and some merges execute. how can i handle thisI have a requirement where I need to run multiple concurrent runs on a particular table, h...
- 18 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
I have a requirement where I need to run multiple concurrent operations on a particular table. However, some merge operations fail while others succeed. How can I handle this?I have tried the following options:Partitioning by primary key – I performe...
- 0 kudos
- 787 Views
- 3 replies
- 5 kudos
A New Era of Databases: Lakebase
Databases have powered software for decades, but their underlying architecture hasn’t kept pace with modern application needs—especially in the era of AI and rapid development. Lakebase introduces a new approach by separating compute from storage an...
- 787 Views
- 3 replies
- 5 kudos
Latest Reply
- 5 kudos
There is a mandatory shift to Autoscaling part of the Lakebase evolution. More details here
- 5 kudos
- 32 Views
- 0 replies
- 0 kudos
Databricks Lake base Evolution - Mandatory Shift from Provisioned Instances to Elastic Autoscaling
The OLTP landscape within the Data Intelligence Platform is undergoing an essential evolutionary step. Databricks has announced an automatic upgrade path shifting all legacy Lake base Provisioned Instances to the modern elastic Lake base Autoscaling ...
- 32 Views
- 0 replies
- 0 kudos
- 40 Views
- 0 replies
- 1 kudos
New in Beta: Unity AI Gateway brings LLM Guardrails, Cost Controls, and MCP Governance
Databricks has expanded Unity AI Gateway with new beta capabilities for service policies, LLM guardrails, payload logging, and cost controls, giving teams one place to govern model calls, agent actions, and MCP interactions as AI moves into productio...
- 40 Views
- 0 replies
- 1 kudos
- 17 Views
- 0 replies
- 0 kudos
We replaced Streamlit with a Python UI compiler we built now deploying on Databricks Apps in hours
Our data team kept hitting the same problem. We needed UIs for business users, dashboards, CRUD apps, internal tools. Streamlit was our go to but it reruns the entire script on every interaction, the interfaces all look identical, and it gets painfu...
- 17 Views
- 0 replies
- 0 kudos
- 70 Views
- 3 replies
- 0 kudos
Import Data from Databricks to SQL Server
Hi our team wants to import data from Databricks catalog tables to SQL server.Is it possible to do so using SSIS package on SQL server ? what settings are required on Databricks tables?Suggest me some ETL tools and how to do it using SSIS
- 70 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Yes, it is possible to integrate SSIS packages with Delta tables using JDBC/ODBC connectivity.Required on Databricks side:SQL Warehouse or interactive clusterJDBC/ODBC driverHostname, HTTP Path, Port 443, and PAT tokenProper table permissions in Unit...
- 0 kudos
- 32 Views
- 0 replies
- 1 kudos
DAIS 2026 Speaker Spotlight Series #6 | Surya Sai Turaga
DAIS 2026 · Speaker Spotlight A conversationwith Surya Sai Turaga On how Ensemble Health Partners turned 800TB of fragmented revenue cycle data into an AI-ready foundation on Databricks Lakebase — and the agentic-AI playbook for healthcare. ...
- 32 Views
- 0 replies
- 1 kudos
- 27 Views
- 0 replies
- 0 kudos
DLT pipeline's compute policy when Instance pool Id used it ignores the VM series.
Hi In Lake flow Spark Declarative Pipelines (formerly DLT) I’m trying to understand how instance pool, cluster policy and DLT pipeline interact, especially around instance type selection.I created an instance pool with Instance type: Standard_DS3_v2 ...
- 27 Views
- 0 replies
- 0 kudos
- 34 Views
- 1 replies
- 0 kudos
Genie Code inline execution is very slow
Hi everyone,I’ve noticed that running inline code in Genie Code has been taking a long time, even for simple tasks.The only workaround I found so far was to explicitly instruct Genie to create notebooks in my personal folder and run the code there in...
- 34 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @lennonantonyy, Thanks for raising this. Yes, I've seen similar reports from others as well. A few people have run into notebook slowness/browser memory pressure when Genie Code is open, including lag while typing and generally poorer performance ...
- 0 kudos
- 4737 Views
- 4 replies
- 0 kudos
Unlocking the Power of Databricks: A Comprehensive Guide for Beginners
In the rapidly evolving world of big data, Databricks has emerged as a leading platform for data engineering, data science, and machine learning. Whether you're a data professional or someone looking to expand your knowledge, understanding Databricks...
- 4737 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
قطار الحرمين 2026 هو أسرع وأريح وسيلة للسفر بين مكة المكرمة والمدينة المنورة. يحوّل هذا القطار الفائق السرعة رحلة كانت تستغرق 4 إلى 6 ساعات على الطريق إلى رحلة مريحة ومكيفة لا تتجاوز ساعتين و20 دقيقة فقط، مما يمنح المعتمرين والحجاج وقتًا أكثر للعبادة...
- 0 kudos
- 63 Views
- 1 replies
- 0 kudos
Databricks excel plugin error
Hi, i have an error with the excel pluging.It was working fine until today. I can login and browse the catalog but I get an error when trying to query any data. It seems like its sending in a blank warehouse id. I have choosen a warehouse and its run...
- 63 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
It looks like the issue is coming from the Snowflake Excel connector not receiving a valid warehouse/endpoint identifier when executing the query.Since login and catalog browsing work fine, authentication is OK — the failure happens at query executio...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2265 | |
| 1315 | |
| 1207 | |
| 1193 | |
| 958 |
| User | Count |
|---|---|
| 432 | |
| 286 | |
| 220 | |
| 63 | |
| 51 |
Latest from our Blog
Do You Still Need a Separate Cloud Data Warehouse? Building an Open Lakehouse for High Performance
You likely maintain at least two separate copies of your crucial data. One resides in your data lake, serving as the source for pipeline writes, ML model training, and engineer debugging. The other is...
[PARTNER BLOG] 847 Models, 12 Weeks, 77% Less: Inside R1's Snowflake-to-Databricks Migration
R1 is a leading provider of revenue management solutions for healthcare organizations, supporting hospitals, health systems, and physician groups across front-, middle-, and back-office revenue operat...
Letting Coding Agents Move Fast Without Breaking Everything
Your preferred AI model is a deeply personal choice. Public benchmarks might declare the “best” model for a specific task, but they don’t account for your workflow or how you access information, which...
The Top 10 Best Practices for AI/BI Dashboards Performance Optimization (Part 2)
This post is the second part of a two-part series on optimizing Databricks AI/BI dashboard performance at scale. In the previous post, we focused how layout, filters, parameters, and caching determin...
