Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 29! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 497 Views
- 0 replies
- 1 kudos
a week ago
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 118 Views
- 0 replies
- 0 kudos
yesterday
DATABRICKS Asia-Pacific Learning Festival Free, virtual, hands-on Databricks training 21 & 22 October 2026 Virtual, labs included Free Ready to level up your Databricks skills? The Databricks Asia-Pacific Learning Festival is back, and ...
- 2797 Views
- 1 replies
- 1 kudos
2 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 2760 Views
- 0 replies
- 3 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 1131 Views
- 0 replies
- 0 kudos
2 weeks ago
Community Champion • September 2026 Meet Venugopal Dabbara Every month, our Community Champion Program recognizes a member who makes the Databricks Community better for everyone, through their knowledge, their willingness to help, and their commitmen...
- 745 Views
- 3 replies
- 6 kudos
2 weeks ago
Genome-wide association studies help identify genetic variations associated with a disease or trait. The Genome-Wide Association Studies Solution Accelerator builds on Glow, an open source project for genomic analysis, to provide a fast, scalable and...
- 296 Views
- 0 replies
- 1 kudos
a week ago
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 368 Views
- 0 replies
- 3 kudos
Thursday
Community Activity
- 0 Views
- 0 replies
- 0 kudos
Upcoming Community BrickTalk | Zerobus Ingest & CDC Workflows
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, November 5! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 0 Views
- 0 replies
- 0 kudos
- 2357 Views
- 12 replies
- 4 kudos
Resolved! Associate data engineering
I see that we have to complete below courses within the upcoming event, I have started the first course which is "Data Ingestion with Lakeflow Connect" and completed 3 to 4 modules of it. Does it count in upcoming event or how to reset that? Would re...
- 2357 Views
- 12 replies
- 4 kudos
Latest Reply
- 4 kudos
Hi @Advika,I completed last module on last day. I haven't got the voucher yet. Could you help me with that?
- 4 kudos
- 238 Views
- 5 replies
- 1 kudos
Table does not support batch scan.
After moving our incremental load jobs from DBR 16.4 (Spark 3.5) to DBR 18 (Spark 4.1.0), they fail with this error: [UNSUPPORTED_FEATURE.TABLE_OPERATION] The feature is not supported: Table `app_dev`.`vw_period` does not support batch scan. Please c...
- 238 Views
- 5 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @harsh120 The RemoteSparkConnectScan in the execution plan is an important clue. On Dedicated compute, Databricks can delegate queries involving fine-grained access controls to serverless compute, which explains why a remote scan may appear. Howev...
- 1 kudos
- 152 Views
- 3 replies
- 0 kudos
Best Architecture for Building a Custom Agent in Databricks?
Hi Everyone,I'm building a Databricks cost optimization agent and would appreciate some guidance on the recommended architecture.My current design consists of the following functions:Retrieve the last N job runs along with cost, DBU usage, runtime, c...
- 152 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
@Vamsi3757 I experimented with a similar use case recently and built a working Spark job cost/performance optimization agent in Databricks.I used a custom Python tool-calling agent with databricks-gpt-oss-120b through Databricks Model Serving, hosted...
- 0 kudos
- 590 Views
- 12 replies
- 11 kudos
Datavault implemention on Databricks
Hi everyone,I'm building a Data Vault 2.0 architecture entirely natively in Databricks from scratch. We have specifically decided not to use dbt.While Raw Vault ingestion is straightforward with Spark/Delta, I'm looking for architectural advice on co...
- 590 Views
- 12 replies
- 11 kudos
Latest Reply
- 11 kudos
HI @ankit2604,I am not able to get what you are saying , when you the same business key is coming from different batch, it will not load into hub as the logic for the hub is such a way that same only one business key per record should exists in hub a...
- 11 kudos
- 19745 Views
- 32 replies
- 21 kudos
FAQ for Advanced Learning Festival September 16 - October 14 2026
Frequently Asked Questions Databricks Advanced Learning Festival | September 16 - October 14 2026 General Where can I ask questions while going through the self-paced material? The Databricks Academy Learners Group page is a forum within the Data...
- 19745 Views
- 32 replies
- 21 kudos
Latest Reply
- 21 kudos
Hi, i have completed both the path for Data Engineer Assoc and Apache Spark Dev but I haven't yet received the voucher. Can you please help? Email add: annabelle.santiago@gmail.com
- 21 kudos
- 57 Views
- 1 replies
- 0 kudos
How do data roles overlap in your Databricks projects?
The other day, my brother asked me a simple question:“What does a Data Engineer actually do?”I started talking about pipelines, databases, and cloud platforms. His face told me that none of it was helping.So I tried a simpler explanation using a libr...
- 57 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello, I think the boundaries between these roles often depend on the size of the team and the complexity of the project. In smaller teams, people naturally take on multiple responsibilities, while larger organizations tend to have more specialized r...
- 0 kudos
- 101 Views
- 2 replies
- 1 kudos
MS Fabric Direct Lake, works with delta tables only?
Lately we started using Direct Lake to use the results of our ingestion pipelines (gold tables) in PBI dashboards. This is working ok but has one annoying and troublesome issue. Which is: the gold tables are the end result of declarative pipelines so...
- 101 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
One approach worth exploring is whether you can eliminate the extra copy by exposing the Databricks gold tables to Fabric through the Mirrored Azure Databricks Catalog feature, then using Direct Lake against the supported mirrored tables.If the curre...
- 1 kudos
- 2172 Views
- 6 replies
- 1 kudos
Resolved! Design Oracle Fusion SCM to Azure Databricks
Hello Techie,I am planning to migrate All module of Oracle fusion scm data to Azure Databricks.Do we have only option of BICC (Business Intelligence Cloud Connector), OR any other option avaialble.Can anyone please help me with reference architecture...
- 2172 Views
- 6 replies
- 1 kudos
Latest Reply
- 1 kudos
The BI Connector writes the Fusion PVO data straight to ADLS Gen2 or any lakehouse/warehouse platform of your choice. Please check out this resource for more info - https://www.biconnector.com/blog/oracle-bicc-integration/
- 1 kudos
- 103 Views
- 4 replies
- 1 kudos
Request correting name in webassesor portal
Hello Support Team,I am writing to request an urgent escalation for Support Case 01048934.Registered Email ID: snehaumapathy424@gmail.comExam Name: Databricks Certified Data Engineer ProfessionalScheduled on : 25 October 2026Date Contact Form Submitt...
- 103 Views
- 4 replies
- 1 kudos
Latest Reply
- 1 kudos
Hello ,Thank you for filing a ticket with our support team, Support team will respond shortly. Please note that we cannot provide support or handle exam suspensions via community (it is not advised that you post your email address here in community)....
- 1 kudos
- 30 Views
- 0 replies
- 0 kudos
Deploy databricks workspace on GCP with your own VPC (BYOVPC)
Presented by Marco Ferraro Hemapriya N
- 30 Views
- 0 replies
- 0 kudos
- 32 Views
- 0 replies
- 0 kudos
- 32 Views
- 0 replies
- 0 kudos
- 118 Views
- 3 replies
- 3 kudos
Resolved! Excel Add-in Trouble (Confirm Button not Enabled)
Has anyone ever gotten the excel add-in to work on Azure Databricks, for Excel? I created a trusted catalog for the Excel Add-in, I launch the Excel, and activate the add-in, I sign into my workspace, I click the button to connect, I select my SQL wa...
- 118 Views
- 3 replies
- 3 kudos
Latest Reply
- 3 kudos
hi @DB1To3 hope the answer was helpful, I would request you to accept it as solution so that it is useful for other community members
- 3 kudos
- 63 Views
- 1 replies
- 0 kudos
How can I get access to Lakehouse//RT Beta in Databricks Free Edition?
Hi Databricks Community,Now I'd like to test Storage-level Transcoding + Lakehouse//RTIs Lakehouse//RT available in Free Edition or Free Trial? If not, how can I request Beta access for hands-on learning?Thanks for your help!
- 63 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
hi @elias2 Short answer: not in Free Edition. Lakehouse//RT is a Beta that your Databricks account team has to enable for the account, and Free Edition has no account team or account console to request it through. Even if the toggle were there, Lakeh...
- 0 kudos
- 35 Views
- 0 replies
- 0 kudos
- 35 Views
- 0 replies
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1504 | |
| 1255 | |
| 1188 | |
| 961 |
Latest from our Blog
Databricks maintenance and cleanup: Visualize, Clean, and Log with Declarative Automation Bundles
Introduction Managing Databricks environments can quickly become overwhelming as jobs, AI Search indexes, and pipeline artifacts accumulate, making manual cleanup, logging, and compliance difficult. T...
Locate, Measure, Judge: A Pattern for Verifiable Visual AI on Databricks (Part 2)
Part 1 introduced the pattern for verifiable visual AI. Let the model find the evidence, use deterministic code to measure it, apply governed rules to produce a pass, review, or fail verdict, and send...
Locate, Measure, Judge: A Pattern for Verifiable Visual AI on Databricks (Part 1)
AI adoption has moved much faster than measurable business results. McKinsey reports that 88% of organizations now use AI in at least one business function, yet only 39% see a bottom-line effect. A co...
Minimize disruptions for continuous pipelines with Maintenance Windows
Minimize disruptions for continuous pipelines with Maintenance Windows In an agentic world, it is more important than ever to make decisions using the latest available data. To achieve this, data engi...
