June 15–18, 2026 Are you building the future with data and AI? Then this is your moment. The Call for Proposals for Data + AI Summit 2026 is officially open, and we want to hear from builders, practitioners, and innovators across the data and AI com...
- 278 Views
- 2 replies
- 4 kudos
Monday
Your voice matters to us. We are planning the 2026 Data + AI Summit, and we’d love your input on what would make the experience even more valuable for you. Take a few minutes to share your feedback through our quick survey — your insights directly in...
- 208 Views
- 3 replies
- 4 kudos
Monday
How to Register & Prepare If you're interested in advancing your skills with Databricks through a Specialist Session, here's a clear guide on how to register and what free courses you can take to prepare effectively. How to Begin Your Learning Path S...
- 2991 Views
- 2 replies
- 9 kudos
10-02-2025
Governing the Full Data Lifecycle: From Ingestion to Insight with Unity Catalog Date: Saturday, December 13 Time: 12:00 PM – 3:00 PM Location: Bengaluru, Karnataka (Register to see address) Registration: Approval required Register Here! About Thi...
- 809 Views
- 1 replies
- 3 kudos
2 weeks ago
Event Details Date: 19 December 2025Time: 6:00 PM – 7:30 PM ISTFormat: Virtual (Online) Marking RSVP on this page will not register your interest for the event. Please use the button below. Unlimited seats — but registration is recommended to recei...
- 767 Views
- 0 replies
- 6 kudos
2 weeks ago
Our Champion program has always celebrated the customers who go above and beyond to engage, help others, and uplift the Community. Recently, we have seen remarkable participation from Bricksters as well—and their impact deserves recognition too. Begi...
- 1108 Views
- 6 replies
- 13 kudos
4 weeks ago
As data volume and complexity increase, engineers are left figuring out how to manage, monitor and maintain fragile pipelines while also handling fragmented tools. The Big Book of Data Engineering equips you with cutting-edge methods for building pip...
- 1415 Views
- 5 replies
- 9 kudos
11-12-2025
We’re inching toward year-end, And the Community just dropped another week packed with sharp questions and standout wins.If you missed the action, here’s the pulse of everything that made the feed light up Week’s Power Players Spotlight on t...
- 254 Views
- 4 replies
- 2 kudos
Friday
Community Activity
- 1 Views
- 0 replies
- 0 kudos
Read Array of Arrays of Objects JSON file using Spark
Hi Databricks Community! This is my first post in this forum, so I hope you can forgive me if it's not according to the forum best practices After lots of searching, I decided to share the peculiar issue I'm running into in this community.I try to lo...
- 1 Views
- 0 replies
- 0 kudos
- 23 Views
- 1 replies
- 1 kudos
Resolved! Lakeflow Connect - Databricks Data Engineer Associate Exam Post-July 2025
Hi, I'm asking another Databricks Data Engineer Associate Exam Dec 2025 question. For those who have taken the DEA exam, is Lakeflow Connect a relevant topic for the test? Been a little confused on what resource to rely on besides the official study ...
- 23 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @rc10000,Lakeflow Connect is mentioned in the exam guide under training, but it’s more about the ingestion concepts. These topics come under the Development & Ingestion section. I’d suggest following the official exam guide first and Databricks Ac...
- 1 kudos
- 36 Views
- 1 replies
- 0 kudos
Voucher For Data Engineer Associate Exam
Hi, I’m preparing for the Databricks Certified Data Engineer Associate exam.Could you please let me know how I can get a voucher or discount code for the exam?Are there any ongoing events, trainings, or promotions that provide vouchers?Thanks in adva...
- 36 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello @Zr50! Databricks offers 50% certification vouchers during its Learning Festival events.The upcoming Learning Festival is scheduled for January 9 – 30, 2026, where you can earn a discount voucher.You can find more details here: Self-Paced Learn...
- 0 kudos
- 3570 Views
- 4 replies
- 6 kudos
Databricks Certified Associate Developer for Apache Spark 3.0 Preparation
Hi All, I am planning to take the Databricks Spark Associate Certification. Please share some useful resources for my preparation.
- 3570 Views
- 4 replies
- 6 kudos
Latest Reply
- 6 kudos
Hi! If you’re preparing for the Databricks Spark Associate Certification, start with the official Databricks documentation and free training courses to understand Spark fundamentals and exam objectives. Along with that, practicing real exam-style que...
- 6 kudos
- 11 Views
- 0 replies
- 0 kudos
Databricks Asset Bundles capability for cross cloud migration
Hi everyone,We are planning a migration from Azure Databricks to GCP Databricks and would like to understand whether Databricks Asset Bundles (DAB) can be used to migrate workspace assets such as jobs, pipelines, notebooks, and custom serving endpoin...
- 11 Views
- 0 replies
- 0 kudos
- 26 Views
- 0 replies
- 0 kudos
How do I grant access to find a table in Databricks, without giving access to query the table?
Hi!By default it seems users can only see tables and views in Unity Catalog that they have SELECT permission/privilege on. However, we would like to use Unity Catalog as a data catalog of tables we have. They wouldn't then be able to request access t...
- 26 Views
- 0 replies
- 0 kudos
- 317 Views
- 6 replies
- 5 kudos
IDENTIFIER in SQL Views not supported?
Dear community,We are phasing out the dollar param `${catalog_name}` because it has been deprecated since runtime 15.2.We use this parameter in many queries and should now be replaced by the IDENTIFIER clause.In the query below where we retrieve data...
- 317 Views
- 6 replies
- 5 kudos
Latest Reply
- 5 kudos
I have good news: in runtime 18, IDENTIFIER and parameter markers are supported everywhere! We need to wait a month or two as the SQL warehouse and serverless are still on runtime 17.
- 5 kudos
- 12 Views
- 0 replies
- 0 kudos
What are the practical differences between bagging and boosting algorithms?
How are bagging and boosting different when you use them in real machine-learning projects?
- 12 Views
- 0 replies
- 0 kudos
- 20 Views
- 0 replies
- 0 kudos
Queries from Serverless compute referring to older/deleted/vacuumed version of the delta tables.
Hi Team,I have a unity catalog based managed delta table which I am able to successfully query using the regular compute/cluster options.But when I try to query the same table using a Serverless/SQL Warehouse, they are referring to an older version /...
- 20 Views
- 0 replies
- 0 kudos
- 327 Views
- 8 replies
- 2 kudos
Create function issue
Hello - I am following some online code to create a function as follows:-----------------------------------------CREATE OR REPLACE FUNCTION my_catalog.my_schema.insert_data_function(col1_value STRING,col2_value INT)RETURNS BOOLEANCOMMENT 'Inserts dat...
- 327 Views
- 8 replies
- 2 kudos
Latest Reply
- 2 kudos
In UC, the functions must be read-only; they cannot modify state (no INSERT, DELETE, MERGE, CREATE, VACUUM, etc). So I tried to create a PROCEDURE and call it; I was able to insert data into the table successfully. Unity Catalog tools are really jus...
- 2 kudos
- 141 Views
- 2 replies
- 0 kudos
Databricks pipeline fails expectation on execute python script, throws error: Update FAILES
Hi Community,I'm new to Databricks and am trying to make and implement pipeline expectations, The pipelines work without errors and my job works. I've tried multiple ways to implement expectations, sql and python. I keep resolving the errors but end ...
- 141 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello, @RobFer1985 The primary cause of your error is a circular reference in your logic: you are defining a table named orders_2 while simultaneously trying to readStream from that same table. In Delta Live Tables (DLT), the function acts as the "wr...
- 0 kudos
- 29 Views
- 0 replies
- 0 kudos
My Databricks Fundamentals Accreditation badge didn't receive
I have completed Databricks Fundamentals Accreditation, but I haven't received the certification badge.Below attached here the certification, and my email address is: deelakawalagama@outlook.com.Also, I would like to add this badge to my LinkedIn pro...
- 29 Views
- 0 replies
- 0 kudos
- 254 Views
- 4 replies
- 6 kudos
🌟 Community Pulse: Your Weekly Roundup! December 05 – 11, 2025
We’re inching toward year-end, And the Community just dropped another week packed with sharp questions and standout wins.If you missed the action, here’s the pulse of everything that made the feed light up Week’s Power Players Spotlight on t...
- 254 Views
- 4 replies
- 6 kudos
- 145 Views
- 2 replies
- 3 kudos
Databricks Advent Calendar 2025 #11
Real-time mode is a breakthrough that lets Spark utilize all available CPUs to process records with single-millisecond latency, while decoupling checkpointing from per-record processing.
- 145 Views
- 2 replies
- 3 kudos
- 33 Views
- 0 replies
- 0 kudos
Databricks Advent Calendar 2025 #16
For many data engineers who love PySpark, the most significant improvement of 2025 was the addition of merge to the dataframe API, so no more Delta library or SQL is needed to perform MERGE. p.s. I still prefer SQL MERGE inside spark.sql()
- 33 Views
- 0 replies
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2183 | |
| 1213 | |
| 1052 | |
| 949 | |
| 875 |
Latest from our Blog
Scaling XGBoost: How to Distribute Training with Ray and GPUs on Databricks
Problem Statement Technologies used: Ray, GPUs, Unity Catalog, MLflow, XGBoost For many data scientists, eXtreme Gradient Boosting (XGBoost) remains a popular algorithm for tackling regression and cla...
Best Practices: Building Compliance-Ready Agentic AI on the Databricks Platform
Financial institutions face a critical challenge: as member bases grow, how do you deliver personalized retirement advice at scale without proportionally increasing costs? More importantly, how do you...
How to perform Semantic Search in Databricks Lakebase
Introduction In today’s AI-native world, applications no longer rely on exact keyword matches—they understand meaning. This shift is powered by embeddings: numerical representations of text that captu...
Driving Revenue with Data: How Vehicle Service Notes Unlock Upsell Opportunities
The Hidden Story in Every Service Visit It’s a busy Tuesday morning at a dealership. A customer pulls in for what should be a simple oil change. The technician performs the inspection, then notices so...
