REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 319 Views
- 0 replies
- 0 kudos
Tuesday
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 15671 Views
- 20 replies
- 18 kudos
2 weeks ago
Virtual Event Time: AMER Sept 23 / 9 AM PTEMEA Sept 24 / 9 AM BST / 10 AM CESTAPJ Sept 24 / 9:30 AM IST / 12 PM SGT / 1 PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: Marking RSVP on this Community ...
- 215 Views
- 0 replies
- 1 kudos
Wednesday
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 2016 Views
- 0 replies
- 2 kudos
4 weeks ago
Our Community Champion Program has always been about recognizing individuals who consistently show up to support others, share their expertise, and strengthen the Databricks Community. Alongside our customers, we’re equally proud to recognize the inc...
- 2955 Views
- 5 replies
- 6 kudos
4 weeks ago
Subscriber attrition can be difficult to anticipate. The Subscriber Churn Prediction Solution Accelerator shows how to analyze behavioral data, identify subscribers at increased risk of cancellation, and use machine learning to estimate churn likelih...
- 179 Views
- 0 replies
- 3 kudos
Tuesday
The Weekly Digest • August 24 – 30 Community Pulse A new week, a fresh wave of articles, answers, and discussions. Here's your weekly catch-up. This Week's Community Stars The members who showed up and made a difference this week : @balajij8...
- 174 Views
- 0 replies
- 1 kudos
Thursday
Community Activity
- 27 Views
- 1 replies
- 2 kudos
Lakeflow SDP Append Flow
Hi All,I'm using append_flow to ingest data into the target table. Before returning the dataframe, I compute few column trnasformations, but those values aren't being calculated correctly (or: aren't showing up at all)so the append flow should not i...
- 27 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @IM_01, append_flow is not limited to just reading a source table. You can (and should) include column transformations, filters, and any other DataFrame operations inside the function decorated with @dp.append_flow. The function simply needs to ...
- 2 kudos
- 132 Views
- 3 replies
- 2 kudos
Databricks vs Snowflake Pyspark Performance
Hi experts, now the competition between cloud providers are fierce and brutal , I come across this post which compares Pyspark performance on databricks and Snowflakehttps://l1nk.dev/1y33h0z although the metics tested are not rigorous and exhaustive...
- 132 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
Good question. A standardized benchmark covering performance, cost, scalability, and different workloads would make these comparisons much more useful for real client discussions.
- 2 kudos
- 100 Views
- 2 replies
- 0 kudos
Recommendation for Data Reconciliation Frameworks (Legacy vs. Migrated Validation)
Hi Team,We need to perform a data quality check between an legacy table and a newly migrated table generated by refactored code. Specifically, we want to validate:Schema & Volumetrics: Total row counts, column counts, and column data type distributio...
- 100 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
This is a great use case for a data reconciliation framework. Automating schema, row counts, aggregates, and row-level hash comparisons would save a lot of manual effort and make migration validation much more reliable.
- 0 kudos
- 21 Views
- 0 replies
- 2 kudos
Just Cleared the Databricks Certified Context Engineer Associate Exam — My Key Takeaways
I'm excited to share that I recently cleared the Databricks Certified Context Engineer Associate certification.What I found most interesting while preparing was how Context Engineering goes beyond prompt engineering. It made me think more deeply abou...
- 21 Views
- 0 replies
- 2 kudos
- 5952 Views
- 12 replies
- 4 kudos
Databricks Job cluster for continuous run
Hi AllI am having situation where I wanted to run job as continuous trigger by using job cluster, cluster terminating and re-creating in every run within continuous trigger.I just wanted two know if we have any option where I can use same job cluster...
- 5952 Views
- 12 replies
- 4 kudos
Latest Reply
- 4 kudos
A Stranger, a Small Conversation, and a New Beginning: My Omezy StoryThe following is a fictional story inspired by the experience of meeting someone new through online random chat.Sometimes, a Stranger Is Exactly Who You NeedThere are days when life...
- 4 kudos
- 46 Views
- 0 replies
- 0 kudos
Best Place to Buy Verified Roblox Account?
Is it possible to buy verified Roblox account in 2026?In 2026, there are many websites to buy verified Roblox accounts, but the problem is how to find a trusted seller.I have a strong experience about that. A few days ago, I bought 2 Roblox accounts ...
- 46 Views
- 0 replies
- 0 kudos
- 2201 Views
- 8 replies
- 8 kudos
FAQ for Advanced Learning Festival September 16 - October 14 2026
Frequently Asked Questions Databricks Advanced Learning Festival | September 16 - October 14 2026 General Where can I ask questions while going through the self-paced material? The Databricks Academy Learners Group page is a forum within the Data...
- 2201 Views
- 8 replies
- 8 kudos
Latest Reply
- 8 kudos
Can anyone guide me for Platform Administration related certification.
- 8 kudos
- 61 Views
- 0 replies
- 0 kudos
Serverless Env v6
Version 6 of the serverless environment is available, which corresponds to runtime 19. more news https://medium.com/databrickscommunity/databricks-news-serverless-genie-code-ltap-lakeflow-61853d8e422a
- 61 Views
- 0 replies
- 0 kudos
- 4056 Views
- 8 replies
- 6 kudos
Resolved! Unexpected Script Execution Differences on databricks.com vs Mobile-Triggered Runtimes
I’m noticing some unusual inconsistencies in how scripts execute on databricks.com compared to when the same workflow is triggered through a mobile-based API. On Databricks, the script runs perfectly when executed directly inside a cluster notebook. ...
- 4056 Views
- 8 replies
- 6 kudos
Latest Reply
- 6 kudos
This kind of difference can be surprisingly easy to miss because the same notebook may behave differently depending on how it is launched. In Databricks, compute type, runtime, permissions, parameters, and whether the execution is interactive or a jo...
- 6 kudos
- 117 Views
- 3 replies
- 3 kudos
Genie - Cost monitoring and usage
Hi Team,Genie is widely used within our department, and we would like to establish appropriate governance around its usage. Do we have any existing guidelines or recommended practices for this? In particular, we are looking for guidance on:Cost monit...
- 117 Views
- 3 replies
- 3 kudos
Latest Reply
- 3 kudos
Hey @Sanjeeb2024, Good to note Genie usage in your org. Databricks does have solid governance tooling for Genie, and it's matured quite a bit since billing went live on July 8, 2026. Here is what you need to know. The source of truth for Genie spend ...
- 3 kudos
- 129 Views
- 2 replies
- 1 kudos
Does enabling Photon improve performance while lowering compute costs?
Please refer screen shot and help in clarifying if enabling Photon lead to lower execution costs?
- 129 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @neerajdubey_86, Photon will almost certainly make your queries faster, but whether it also makes them cheaper depends on your workload. Photon is Databricks native vectorized query engine. It replaces the JVM-based Spark execution layer with ...
- 1 kudos
- 98 Views
- 0 replies
- 0 kudos
I Stopped Sending Every Data Engineering Task to an LLM - A Cost Aware Routing Pattern on Databricks
AI is becoming part of almost every data engineering workflow.We are asking AI to generate SQL, PySpark pipelines, data-quality rules, unit tests, technical specifications and even complete project structures. The results can be impressive, but there...
- 98 Views
- 0 replies
- 0 kudos
- 42479 Views
- 37 replies
- 34 kudos
Resolved! Free Certification voucher
looking for free certification voucher
- 42479 Views
- 37 replies
- 34 kudos
Latest Reply
- 34 kudos
You can check for the upcoming Learning Festivals for discount vouchers in June-August or October-November. You can check the upcoming learning events here
- 34 kudos
- 81 Views
- 0 replies
- 0 kudos
Databricks-Native AI Agent for Job Incident Detection, RCA & Safe Remediation
I’m exploring an architecture for a Databricks-native AI Agent for intelligent Spark job incident detection, root cause analysis (RCA), and safe remediation, and I would love your technical feedback.The ProblemA common operational challenge is the "S...
- 81 Views
- 0 replies
- 0 kudos
- 99 Views
- 0 replies
- 1 kudos
Building Custom Agents on Databricks:LangGraph, Atlan-Grounded Routing, and Per-Run Cost with MLflow
The problem: rethinking routing in multi-agent systems on DatabricksDatabricks native supervisor agent pattern is a solid default for orchestrating multiple Genie spaces and tools but it comes with a routing constraint worth examining. The superviso...
- 99 Views
- 0 replies
- 1 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1382 | |
| 1253 | |
| 1186 | |
| 961 |
Latest from our Blog
Lakeflow Connect: Message Bus Ingestion - Now shipping your logs directly! (Beta)
Take a quick inventory of where your operational data lives right now. There is probably a Kafka cluster carrying your event backbone, or perhaps RabbitMQ capturing messages on a factory floor or bet...
GeoGenie 2: Ask your map a question in plain English
A year ago we put a natural-language layer on a 3D map. This time we rebuilt the whole thing on Lakebase and PostGIS, wired Genie to the same tables, and made the map answer back, drawn region and all...
Custom Visualizations in Databricks AI/BI Dashboards: Build a Dumbbell Chart
Many dashboards eventually answer the same questions: Are we hitting our targets?Where are we falling short? A dumbbell chart answers these questions at a glance. For each category, it plots two valu...
Managing Databricks Genie Agents as Code with Databricks Declarative Automation Bundles (DAB)
Databricks Genie Agents (formerly Genie Spaces) are domain-specific, no-code chat interfaces that let business users ask natural-language questions about their data and get back SQL queries, result ta...
