Ready to level up your skills before the biggest data and AI event of the year? From May 27 through June 3, we are cutting prices in half. Expert-led training courses are just $212.50 each! Register for Data + AI Summit today and pick from 20+ hands...
- 38 Views
- 0 replies
- 1 kudos
2 hours ago
Hey Databricks Community! Join us for a free Databricks Community sponsored BrickTalk on Thursday, June 4! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with dat...
- 155 Views
- 0 replies
- 0 kudos
Tuesday
We promised something special and here it is. We're thrilled to introduce the DAIS 2026 Community Virtual Challenge, open to every member of the Databricks Community, wherever you are in the world. Opens: May 15, 2026 Closes: May 31, 2026 Winners...
- 1447 Views
- 5 replies
- 7 kudos
2 weeks ago
We’re getting ready to pilot the Databricks Detective Series ahead of its launch at Data + AI Summit 2026, and we’re looking for Community members to help test it. Databricks Detective Series is a free, gamified, hands-on experience where you become...
- 1047 Views
- 8 replies
- 8 kudos
2 weeks ago
Calling all builders!Since GA, thousands of teams have moved production workloads onto Lakebase. We want to hear how you’re using it.A few examples of stories we’d love to capture: Building stateful AI agents that need persistent memory alongside lak...
- 802 Views
- 9 replies
- 1 kudos
2 weeks ago
Already registered for Data + AI Summit 2026? Join us on Monday, June 15 for the Databricks Apps & Agents for Good Hackathon 2026, hosted in partnership with OpenAI. Secure your spot and apply by Sunday May, 31 Note: Marking RSVP on this Community ...
- 600 Views
- 1 replies
- 1 kudos
2 weeks ago
DAIS 2026 · Speaker Spotlight A conversationwith Christophe Chieu On using Genie to automate invoice reconciliation, variance analysis, and reporting — and accelerate the monthly close for finance teams. The Session Accelerating Monthly Fin...
- 95 Views
- 0 replies
- 0 kudos
11 hours ago
Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individuals whose passion fo...
- 1888 Views
- 6 replies
- 7 kudos
a week ago
Survival analysis is a set of statistical methods used to examine and predict the time until an event happens. This Survival Analysis for Churn and Lifetime Value Solution Accelerator shows how these techniques can be used to predict churn, calculate...
- 178 Views
- 0 replies
- 1 kudos
Tuesday
The Weekly Digest • May 11 – May 17 Community Pulse Catch up on the week's best discussions, articles, and announcements -- fast. Top Contributors This Week Contributors leading with curiosity and kindness: @KrisJohannesen @Sumit_7 @amirabe...
- 350 Views
- 1 replies
- 3 kudos
a week ago
Community Activity
- 2662 Views
- 3 replies
- 0 kudos
Autoloader cloudFiles.maxFilesPerTrigger ignored with .trigger(availableNow=True)?
Hi, I'm using the Auto Loader feature to read streaming data from Delta Lake files and process them in a batch. The trigger is set to availableNow to include all new data from the checkpoint offset but I limit the amount of delta files for the batch ...
- 2662 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
For others who run into this issue:Changing `cloudFiles.maxFilesPerTrigger` to `maxFilesPerTrigger` is not the solution. Check your checkpoint state first.If a previous Auto Loader run failed or was cancelled after files had already been discovered/p...
- 0 kudos
- 38 Views
- 0 replies
- 1 kudos
FLASH SALE: Save 50% on Summit Training ⚡
Ready to level up your skills before the biggest data and AI event of the year? From May 27 through June 3, we are cutting prices in half. Expert-led training courses are just $212.50 each! Register for Data + AI Summit today and pick from 20+ hands...
- 38 Views
- 0 replies
- 1 kudos
- 59 Views
- 2 replies
- 0 kudos
Resolved! Work-around for cloning a repo with notebooks too big
Hi,It would be nice to be able to clone https://github.com/shap/shap into Databricks, it being such a standard. But it fails because some of the notebooks violate a Databricks size limit. Using sparse clone mode I can force my way through getting m...
- 59 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
This looks sufficient, thanks. I was able to run a clone in the CLI. The folder ends up in an invalid git state, but that appears to be because the beta feature isn't turned on for my workspace yet.
- 0 kudos
- 74 Views
- 5 replies
- 2 kudos
Overwriting Job and Task parameters
Hello there, Regarding the subject: Deploy Workloads with Lakeflow Jobs and Tasks, the current standard override rule seems to be reverted. "Job Parameters override Task Parameters when same key exists." Following class inheritance and scope restrict...
- 74 Views
- 5 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @iurix, Great question.. If you come at it from a scope/locality perspective, it does feel more intuitive for a task-level parameter to win over a job-level parameter when the same key exists. But Databricks currently models this differently in L...
- 2 kudos
- 83 Views
- 0 replies
- 0 kudos
What’s new in the Lakeflow Pipelines Editor
Excited to share that the Lakeflow Pipelines Editor is now generally available! This is the new experience for building Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables pipelines). We shipped a few new features inside it that we'd lov...
- 83 Views
- 0 replies
- 0 kudos
- 30 Views
- 0 replies
- 0 kudos
Best Approach for Per-User Authentication with Databricks in an Agent-Based System
Hello everyone,I have built an ADK-based agent that connects to Databricks and can retrieve various information. However, I’m trying to design a secure way to authenticate each user individually when they interact with the agent.So far, I see two pos...
- 30 Views
- 0 replies
- 0 kudos
- 43 Views
- 1 replies
- 0 kudos
Embedding a dashboard in Databricks
Hi, I try to embed my dashboard in Databricks Notebook as some_html = """ <iframe src="...." width="100%" height="600" frameborder="0"> </iframe> """ displayHTML(some_html) then I get an error of the form: This dashboard is unavailablePlease...
- 43 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @vvanag, What you’re trying to do is understandable, but I wouldn’t recommend embedding an AI/BI dashboard back into a Databricks notebook with displayHTML and a raw iframe. The documented embedding path for AI/BI Dashboards is to embed them in an...
- 0 kudos
- 114 Views
- 2 replies
- 1 kudos
Auto Loader on UC Volumes stopped resolving wildcards
The following spark.readStream / cloudFiles configuration was confirmed working on2026-04-30, but stopped working on 2026-05-26. No code or config changes were madebetween these dates, so I assume something was changed implicitly on the Databricks si...
- 114 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
We are facing a similar issue, not limited to Autoloader but also affecting DLT pipelines and classic ETL job. The behavior is intermittent, jobs run fine and then fail unexpectedly, though they typically succeed on retry if retries are enabled. We t...
- 1 kudos
- 44 Views
- 1 replies
- 0 kudos
Databricks Is No Longer Just a Data Platform
Databricks is no longer just a big data platform.It’s becoming the primary platform solution for companies to bring together their data, AI, analytics, and machine learning — all in one ecosystem.Built on Apache Spark, Databricks transformed how orga...
- 44 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
@tushar_sable Well I guess you're seeing it now buddy - DB has already been a complete package!
- 0 kudos
- 2675 Views
- 5 replies
- 3 kudos
Databricks Data Analyst Associate Exam – Any Tips or Insights?
Hi Guys,Has anyone sat the Databricks Certified Data Analyst Associate exam so far? I’m planning to take this exam next month and would really appreciate it if you could share your experience.How was the difficulty level overall? Were the questions m...
- 2675 Views
- 5 replies
- 3 kudos
Latest Reply
- 3 kudos
@Murtaza_Ghafoor There's an learning event coming up next month - so keep an eye to get 50% off.
- 3 kudos
- 428 Views
- 2 replies
- 0 kudos
Training
I have signed up for training but when I log into Databricks it takes me to the account free edition and not giving me the option to get to my training.
- 428 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
I now see the course but it’s just a video and jo meeting to join! Why is this so complicated!!!
- 0 kudos
- 75 Views
- 1 replies
- 0 kudos
Resolved! Serverless compute outbound IP whitelisting for external API calls
I’m trying to understand the networking implications of moving some logic to Databricks Serverless / SDP.My current setup is a notebook running as a job on classic compute, and this works because outbound traffic goes through a NAT Gateway, so we can...
- 75 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @mnissen1337, Your understanding is basically right. With classic compute, the workload runs in your own VNet/VPC, so using your own NAT Gateway to present a stable public egress IP is a standard pattern. With serverless, the compute runs in the D...
- 0 kudos
- 100 Views
- 5 replies
- 1 kudos
Resolved! Rendering HTML in ipywidgets output
Hi, I am experimenting with IPywidgets on Databricks (company Azure account and Free Edition).I have an HTML that I would like to render so typically what happens is that simple things like:import ipywidgets as widgets output = widgets.Output() wit...
- 100 Views
- 5 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @vvanag, What you’re seeing is expected to some extent in Databricks Notebooks. Databricks supports ipywidgets, but it doesn’t guarantee full Jupyter or Colab parity, and there are a few documented limitations on how widgets render and behave in n...
- 1 kudos
- 47 Views
- 1 replies
- 0 kudos
Webassessor/Kryterion account issue blocking Databricks cert test booking
I’m trying to schedule a Databricks cert test booking, but I’m blocked because of an issue with my Webassessor/Kryterion account.I already contacted Kryterion support, and they told me this has to be handled by Databricks support. I submitted the Dat...
- 47 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello @Techie007 ,Thank you for filing a ticket with our support team, Support team will respond shortly. Please note that we cannot provide support via community.Thanks & Regards,@cert-ops
- 0 kudos
- 65 Views
- 0 replies
- 1 kudos
Learning Series | Machine Learning Operations
Databricks Academy offers the free Machine Learning Operations course to help machine learning practitioners understand how to manage models more effectively across the ML lifecycle on the Databricks Data Intelligence Platform. As the fourth course i...
- 65 Views
- 0 replies
- 1 kudos
Announcements
| User | Count |
|---|---|
| 2266 | |
| 1315 | |
| 1214 | |
| 1193 | |
| 958 |
| User | Count |
|---|---|
| 434 | |
| 286 | |
| 220 | |
| 63 | |
| 51 |
Latest from our Blog
What’s new in the Lakeflow Pipelines Editor
Excited to share that the Lakeflow Pipelines Editor is now generally available! This is the new experience for building Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables pipelines). We ...
[PARTNER BLOG] Why Leaders Need a “Databricks-in-a-Box” Strategy
The Enterprise Data Challenge Leaders Face Today Most enterprises are no longer asking whether they should modernize their data ecosystem. The real question is: How quickly can we accomplish th...
Databricks Serverless Migration: A Practical Production Playbook
A single knowledge resource bridging platform limits, real PoC lessons, and automated ways of refactoring workflows Databricks Serverless drives operational efficiency and slashes maintenance costs by...
From Surprise Full Refreshes to Predictable Bills: REFRESH POLICY for MVs
You created a materialized view. You assumed it refreshed incrementally. Then, at 6 a.m., a refresh on a billion-row source ran a full recompute, and your monthly Databricks bill grew a leg. This is t...
