June 15–18, 2026 Are you building the future with data and AI? Then this is your moment. The Call for Proposals for Data + AI Summit 2026 is officially open, and we want to hear from builders, practitioners, and innovators across the data and AI com...
- 246 Views
- 2 replies
- 4 kudos
yesterday
Your voice matters to us. We are planning the 2026 Data + AI Summit, and we’d love your input on what would make the experience even more valuable for you. Take a few minutes to share your feedback through our quick survey — your insights directly in...
- 177 Views
- 3 replies
- 4 kudos
yesterday
How to Register & Prepare If you're interested in advancing your skills with Databricks through a Specialist Session, here's a clear guide on how to register and what free courses you can take to prepare effectively. How to Begin Your Learning Path S...
- 2983 Views
- 2 replies
- 9 kudos
10-02-2025
Governing the Full Data Lifecycle: From Ingestion to Insight with Unity Catalog Date: Saturday, December 13 Time: 12:00 PM – 3:00 PM Location: Bengaluru, Karnataka (Register to see address) Registration: Approval required Register Here! About Thi...
- 787 Views
- 1 replies
- 3 kudos
2 weeks ago
Event Details Date: 19 December 2025Time: 6:00 PM – 7:30 PM ISTFormat: Virtual (Online) Marking RSVP on this page will not register your interest for the event. Please use the button below. Unlimited seats — but registration is recommended to recei...
- 749 Views
- 0 replies
- 6 kudos
2 weeks ago
Our Champion program has always celebrated the customers who go above and beyond to engage, help others, and uplift the Community. Recently, we have seen remarkable participation from Bricksters as well—and their impact deserves recognition too. Begi...
- 1097 Views
- 6 replies
- 13 kudos
4 weeks ago
As data volume and complexity increase, engineers are left figuring out how to manage, monitor and maintain fragile pipelines while also handling fragmented tools. The Big Book of Data Engineering equips you with cutting-edge methods for building pip...
- 1408 Views
- 5 replies
- 9 kudos
11-12-2025
We’re inching toward year-end, And the Community just dropped another week packed with sharp questions and standout wins.If you missed the action, here’s the pulse of everything that made the feed light up Week’s Power Players Spotlight on t...
- 240 Views
- 4 replies
- 2 kudos
Friday
Community Activity
- 11 Views
- 0 replies
- 0 kudos
My Databricks Fundamentals Accreditation badge didn't receive
I have completed Databricks Fundamentals Accreditation, but I haven't received the certification badge.Below attached here the certification, and my email address is: deelakawalagama@outlook.com.Also, I would like to add this badge to my LinkedIn pro...
- 11 Views
- 0 replies
- 0 kudos
- 14 Views
- 0 replies
- 0 kudos
Voucher For Data Engineer Associate Exam
Hi, I’m preparing for the Databricks Certified Data Engineer Associate exam.Could you please let me know how I can get a voucher or discount code for the exam?Are there any ongoing events, trainings, or promotions that provide vouchers?Thanks in adva...
- 14 Views
- 0 replies
- 0 kudos
- 302 Views
- 5 replies
- 4 kudos
IDENTIFIER in SQL Views not supported?
Dear community,We are phasing out the dollar param `${catalog_name}` because it has been deprecated since runtime 15.2.We use this parameter in many queries and should now be replaced by the IDENTIFIER clause.In the query below where we retrieve data...
- 302 Views
- 5 replies
- 4 kudos
Latest Reply
- 4 kudos
I have good news: in runtime 18, IDENTIFIER and parameter markers are supported everywhere! We need to wait a month or two as the SQL warehouse and serverless are still on runtime 17.
- 4 kudos
- 240 Views
- 4 replies
- 5 kudos
🌟 Community Pulse: Your Weekly Roundup! December 05 – 11, 2025
We’re inching toward year-end, And the Community just dropped another week packed with sharp questions and standout wins.If you missed the action, here’s the pulse of everything that made the feed light up Week’s Power Players Spotlight on t...
- 240 Views
- 4 replies
- 5 kudos
- 304 Views
- 7 replies
- 2 kudos
Create function issue
Hello - I am following some online code to create a function as follows:-----------------------------------------CREATE OR REPLACE FUNCTION my_catalog.my_schema.insert_data_function(col1_value STRING,col2_value INT)RETURNS BOOLEANCOMMENT 'Inserts dat...
- 304 Views
- 7 replies
- 2 kudos
Latest Reply
- 2 kudos
In UC, the functions must be read-only; they cannot modify state (no INSERT, DELETE, MERGE, CREATE, VACUUM, etc). So I tried to create a PROCEDURE and call it; I was able to insert data into the table successfully. Unity Catalog tools are really jus...
- 2 kudos
- 138 Views
- 2 replies
- 3 kudos
Databricks Advent Calendar 2025 #11
Real-time mode is a breakthrough that lets Spark utilize all available CPUs to process records with single-millisecond latency, while decoupling checkpointing from per-record processing.
- 138 Views
- 2 replies
- 3 kudos
- 15 Views
- 0 replies
- 0 kudos
Databricks Advent Calendar 2025 #16
For many data engineers who love PySpark, the most significant improvement of 2025 was the addition of merge to the dataframe API, so no more Delta library or SQL is needed to perform MERGE. p.s. I still prefer SQL MERGE inside spark.sql()
- 15 Views
- 0 replies
- 0 kudos
- 2652 Views
- 1 replies
- 1 kudos
"Error: cannot read mws credentials: invalid Databricks Account configuration" on TF Destroy
I have a terraform project that creates a workspace in Databricks, assigns it to an existing metastore, then creates external location/storage credential/catalog. The apply works and all expected resources are created. However, without touching any r...
- 2652 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
I have the same problem, were you able to solve it?
- 1 kudos
- 63 Views
- 3 replies
- 4 kudos
Resolved! Issues while running SYNC SCHEMA (HIVE-6384)
Hi All, We are in a process of migrating to UC from HMS and also changing the DBR from 11.3 to 16.4 LTS. When i am running sync schema from HMS to UC i am getting "Parquet does not support date. See HIVE-6384" error. Trying to resolve this, i have di...
- 63 Views
- 3 replies
- 4 kudos
Latest Reply
- 4 kudos
@yashojhaIf you are doing HMS to UC migration. It is worth checking UCX an automated Unity catalog migration tool.https://github.com/databrickslabs/ucx
- 4 kudos
- 17 Views
- 0 replies
- 0 kudos
Take My TEAS Exam: Smart Preparation Strategies for Success and Confidence
Preparing for the TEAS requires planning, practice, and confidence. This thread shares study schedules, reliable resources, and stress management tips to boost scores ethically. If you search phrases like take my teas exam for me, remember true succe...
- 17 Views
- 0 replies
- 0 kudos
- 59 Views
- 4 replies
- 0 kudos
Power BI refresh job task
I have tried Databricks job task to refresh power bi dataset and I have found 2 issues.1. I set up tables in Power BI Desktop using Import mode. After deploying the model to Power BI Service, I was able to download it as an Import mode model. However...
- 59 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
Can you send a screenshot of the refresh power BI task in the jobs UI within Databricks please?
- 0 kudos
- 72 Views
- 4 replies
- 2 kudos
Dataflow Gen2 Timeout When Loading Databricks Tables
I created a Dataflow Gen2 to get data from Databricks. I can see the preview data very quickly (around 5 seconds). But when I run the dataflow, it takes 8 hours and then cancels with a timeout. I’m trying to get 8 tables with the same schema. Six of...
- 72 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
Do you think the Databricks cluster that Microsoft Fabric is connected to needs more capacity?
- 2 kudos
- 106 Views
- 5 replies
- 0 kudos
Extract Snowflake data based on environment
Hi all, In the development workspace, I need to extract data from a table/view in Snowflake development environment. Example table is called as VD_DWH.SALES.SALES_DETAILWhen we deploy the code into production, it needs to extract data from a table/vi...
- 106 Views
- 5 replies
- 0 kudos
Latest Reply
- 0 kudos
Create a single job that runs your migration notebook.In the job settings, under Parameters, add a key like env with a default value (e.g., dev).When you create different job runs (or schedule them), override the parameter:For development runs, set e...
- 0 kudos
- 177 Views
- 3 replies
- 7 kudos
Last Chance: Help Shape the 2026 Data + AI Summit | Win a Full Conference Pass
Your voice matters to us. We are planning the 2026 Data + AI Summit, and we’d love your input on what would make the experience even more valuable for you. Take a few minutes to share your feedback through our quick survey — your insights directly in...
- 177 Views
- 3 replies
- 7 kudos
Latest Reply
- 7 kudos
@Sujitha I have submitted my response too. Looking forward to the DAIS 26
- 7 kudos
- 44 Views
- 2 replies
- 0 kudos
How do you manage alerts?
Hey all,I'm curious how do teams manage Databricks alerts?My use case is that I have around 10 Spark workflows, and need to validate their output tables.My first iteration was to create alerts manually, e.g. define SQL, evaluation criteria, notificat...
- 44 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @smirnoal ,If you want to have more dynamic behaviour you can use Python for Databricks Asset Bundles which extends Databricks Asset Bundles so that you can:Define resources in Python code. These definitions can coexist with resources defined in Y...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2182 | |
| 1213 | |
| 1051 | |
| 949 | |
| 875 |
Latest from our Blog
Scaling XGBoost: How to Distribute Training with Ray and GPUs on Databricks
Problem Statement Technologies used: Ray, GPUs, Unity Catalog, MLflow, XGBoost For many data scientists, eXtreme Gradient Boosting (XGBoost) remains a popular algorithm for tackling regression and cla...
Best Practices: Building Compliance-Ready Agentic AI on the Databricks Platform
Financial institutions face a critical challenge: as member bases grow, how do you deliver personalized retirement advice at scale without proportionally increasing costs? More importantly, how do you...
How to perform Semantic Search in Databricks Lakebase
Introduction In today’s AI-native world, applications no longer rely on exact keyword matches—they understand meaning. This shift is powered by embeddings: numerical representations of text that captu...
Driving Revenue with Data: How Vehicle Service Notes Unlock Upsell Opportunities
The Hidden Story in Every Service Visit It’s a busy Tuesday morning at a dealership. A customer pulls in for what should be a simple oil change. The technician performs the inspection, then notices so...
