NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...
- 2613 Views
- 1 replies
- 1 kudos
2 weeks ago
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 1843 Views
- 0 replies
- 2 kudos
3 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 4333 Views
- 0 replies
- 4 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 1254 Views
- 0 replies
- 1 kudos
3 weeks ago
Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...
- 769 Views
- 1 replies
- 5 kudos
3 weeks ago
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 957 Views
- 0 replies
- 4 kudos
4 weeks ago
Community Activity
- 161 Views
- 3 replies
- 4 kudos
Memory Profiling
How do you debug OOM on long-running streaming jobs?Hi All,One of my Structured Streaming jobs has started dying with OutOfMemoryError. Runs fine for about approx 40 hours, then falls over, restarts, and does the same thing again. I had introduced fe...
- 161 Views
- 3 replies
- 4 kudos
Latest Reply
- 4 kudos
Seems there are not many practical docs and videos around Databricks Jobs memory profiling!
- 4 kudos
- 34 Views
- 0 replies
- 0 kudos
Missing spark structured streaming metadata blobs?
I'm exploring spark structured streaming, and contemplating uses for it.I'd like to launch a job on a recurring basis from an external scheduler. It will launch a spark job with trigger (availableNow=True). I'm concerned about overlapping executions...
- 34 Views
- 0 replies
- 0 kudos
- 183 Views
- 3 replies
- 1 kudos
Databricks exam got suspended. Need urgent help
Hello Team, I faced multiple interruptions and challenges while attempting my certification, The exam got paused automatically without any violation,i had also contacted kryterion, but they told Databricks could only help on this issue. Eventually my...
- 183 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
@pss20 sorry, it looks to me like you received misinformation about where to file a support ticket... certification support is here: https://help.databricks.com/s/contact-us?ReqType=training
- 1 kudos
- 10187 Views
- 4 replies
- 2 kudos
Resolved! Networking Challenges with Databricks Serverless Compute (Control Plane) When Connecting to On-Prem
Hi Databricks Community,I'm working through some networking challenges when connecting Databricks clusters to various data sources and wanted to get advice or best practices from others who may have faced similar issues.Current Setup:I have four type...
- 10187 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @chandru44 and @bitc, I’m adding an update because this thread still comes up for anyone researching this topic, and a few things have changed since the accepted answer. Thanks @Louis_Frolio, the hybrid sync pattern is still the right default for ...
- 2 kudos
- 43 Views
- 0 replies
- 0 kudos
Seven checks before a Unity Gateway rollout
Dear Community Members,I’ve put together a practical guide to Databricks Unity Gateway, focusing on model access, MCP permissions, policy handling, and cost attribution.Here are seven checks I recommend before expanding a rollout:Verify that the inte...
- 43 Views
- 0 replies
- 0 kudos
- 5408 Views
- 5 replies
- 5 kudos
Trouble Launching your Certification Exam? Read this now!
Hey there, test-takers! We know that launching your certification exam can be a bit nerve-wracking, especially if you encounter technical issues. But don't worry, Kryterion is available to help you!If you experience technical difficulties during set-...
- 5408 Views
- 5 replies
- 5 kudos
Latest Reply
- 5 kudos
Thanks for sharing. Planning to go for a certification exam soon again.
- 5 kudos
- 157 Views
- 2 replies
- 0 kudos
ASF Corporation
Hello Databricks Community,I'm representing ASF CORPORATION, a piling, foundation engineering and construction company established in 2017 and based in Dhaka, Bangladesh.Our company specializes in hydraulic rotary piling, rotary drilling, auger borin...
- 157 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @asfcorporation, and welcome to the Databricks Community!Beyond the usual Lakeflow + Unity Catalog + AI/BI Dashboards stack, I’d suggest not inventing your own schema: geotechnical data already has open standards. AGS4 (UK) and DIGGS (US, by ASCE ...
- 0 kudos
- 74 Views
- 0 replies
- 0 kudos
Databricks Training Team Support Request #01069662 - Exam Suspension Regarding
My exam was suspended due to an automated flag stating I was "looking away." I want to clarify that I never left the camera frame or looked at external materials; I was simply looking to the side while concentrating on the options. This certification...
- 74 Views
- 0 replies
- 0 kudos
- 79 Views
- 2 replies
- 1 kudos
Best approach for migrating SAP BW to Databricks?
Hey folks,We are scoping out a migration to move our legacy SAP BW setup over to Databricks.Our main concern is the amout of logic tied up in old ADSOs, infpCubes and custom ABAP transformations routines. Manually rewriting everything into PySpark se...
- 79 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @Office_Solution For an SAP BW migration, I would recommend a phased approach rather than trying to replicate the existing BW architecture one-to-one in Databricks.1. Mapping ADSOs and InfoCubes to Delta LakeYou can map the existing BW objects bas...
- 1 kudos
- 107 Views
- 2 replies
- 3 kudos
DevOps Fundamentals: Lecture - Deploying Databricks Assets Overview
I cannot make sense of this sentence:By treating Databricks resources as code, DABs enables peer review through standard Git Lakeflow Jobs like pull requestsThere are other problems with this lecture that light review or AI review would easily catch....
- 107 Views
- 2 replies
- 3 kudos
Latest Reply
- 3 kudos
By treating Databricks resources as code, DABs enables peer review through standard Git Lakeflow Jobs like pull requestsThat means keeping all resources such as Jobs, Servings, lakeflow, Dashboards as code at Github repo and deploy through DABs allow...
- 3 kudos
- 135 Views
- 1 replies
- 0 kudos
Unable to Reschedule Databricks Generative AI Associate Exam
I have scheduled my Databricks Generative AI Associate exam for 14th Nov. However, as I am not fully prepared, I would like to postpone the exam to December.Unfortunately, when I try to reschedule, the available options only allow me to prepone the e...
- 135 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Short answer: you can still move it yourself in Webassessor, but only while you are more than 24 hours before the start time for an online-proctored exam (72 hours for a test center) [1]. With the exam on 14 Nov, do it before the same time on 13 Nov....
- 0 kudos
- 63 Views
- 0 replies
- 1 kudos
Share Your AI Proctoring Experience During a Databricks Exam
Overall, my AI proctoring experience during the Databricks exam was good. However, there was one interesting challenge: even when you naturally move your eyes from left to right while reading a question, the system flags you for moving your eyeballs!...
- 63 Views
- 0 replies
- 1 kudos
- 537 Views
- 8 replies
- 14 kudos
How to Connect Databricks to Snowflake & Query Live Data?
Hi everyone,I am looking for a method to connect Databricks to Snowflake so I can query and transform the data directly in a notebook. I specifically want to avoid methods that just perform a one-time copy of the tables into Databricks, as I need the...
- 537 Views
- 8 replies
- 14 kudos
Latest Reply
- 14 kudos
Hello @Raj_DB, I took a look at both internal and external documentation and here is what I found. The thread already has the right answer: Lakehouse Federation. @saurabh18cs, @Harshad_B, @AbhilashNagilla, @Aravind_Reddy, @Jen_Evangelista and @balaji...
- 14 kudos
- 1584 Views
- 22 replies
- 8 kudos
MS Fabric Direct Lake, works with delta tables only?
Lately we started using Direct Lake to use the results of our ingestion pipelines (gold tables) in PBI dashboards. This is working ok but has one annoying and troublesome issue. Which is: the gold tables are the end result of declarative pipelines so...
- 1584 Views
- 22 replies
- 8 kudos
Latest Reply
- 8 kudos
Hi @dbernstein_tp,Thanks for testing all of that and reporting back. Good to know deletion vectors didn't upset Direct Lake.I think your two findings are really the same problem. If most of the gold MVs are fully recomputed on every update, each refr...
- 8 kudos
- 77 Views
- 0 replies
- 0 kudos
Delivery Expert badge not received – Data Governance & Security
Hi everyone! I completed all the courses in the Data Governance & Security learning plan and hold the Databricks Certified Data Engineer Professional certification, which meets the certification prerequisite.It’s been more than 72 hours, but I haven’...
- 77 Views
- 0 replies
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1508 | |
| 1255 | |
| 1190 | |
| 961 |
Latest from our Blog
An example of AI coworker for people who have never queried data
An example of AI coworker for people who have never queried data Talking to your data doesn't mean your data understands you. AI knows data and query languages, but it must also learn the specific jar...
Controlling Genie budget under the new pay-as-you-go model
In my role as an architect and customer advisor, I often find that governance, security, and cost control come up together. That is understandable. As organisations move from AI experimentation to ent...
Gold Isn't Enough: Building the Context Layer for Conversational AI
Bronze, Silver, and Gold made data trustworthy. Conversational AI needs a 4th layer: governed meaning. Here's how to build it on Databricks. Two right answers, one wrong decision A VP of Customer Care...
How to stream PostgreSQL CDC into Databricks with Debezium
Data stored in operational databases powers critical business decisions, but making it available in the lakehouse presents significant architecture challenges. Strict enterprise environments could ha...
