cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 
Databricks Advanced Learning Festival: November 10 - December 08 2026

Databricks Advanced Learning Festival November 10 – December 8, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are ...

  • 69819 Views
  • 127 replies
  • 21 kudos
10-08-2026
✈️ 9 Cities, 1 Epic November: The Data + AI World Tour is Here!

NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...

  • 3829 Views
  • 1 replies
  • 2 kudos
4 weeks ago
DATA + AI World Tour 2026

REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...

  • 5159 Views
  • 0 replies
  • 4 kudos
09-01-2026
Databricks Community Champion - October 2026 - Anuj Lathi

Community Champion • October 2026 Meet Anuj Lathi Behind every resolved question in the Databricks Community is someone who chose to share what they know. Our Community Champion Program recognizes those who consistently support others, from beginners...

  • 347 Views
  • 3 replies
  • 5 kudos
Wednesday
Solution Accelerator Series | Salesforce Bring Your Own Model

You can use Databricks to train and serve machine learning models for workloads in Salesforce. The Salesforce Bring Your Own Model (BYOM) Solution Accelerator walks through connecting Salesforce data with Databricks, building and managing models, and...

  • 143 Views
  • 0 replies
  • 1 kudos
Wednesday
🌟 Community Pulse: Your Community Roundup! October 12 – November 15, 2026

Monthly Recap • October 12 – November 15 Community Pulse Here are the highlights, sorted so you can jump to what you care about. This Month's Community Stars   The members who showed up and made a difference this month: @data_pulse @SumeshKash...

  • 326 Views
  • 1 replies
  • 4 kudos
Thursday

Community Activity

Office_Solution
by > • New Contributor III
  • 592 Views
  • 4 replies
  • 0 kudos

Resolved! Best approach and tools for migrating from Oracle to Databricks?

Hey everyone,We're planning to migrate our data warehouse from Oracle to Databricks. We have a mix of standard tables and a good amount of legacy PL/SQL code to deal with.What is the best way to approach this migration? specifically:1) How do you usu...

  • 592 Views
  • 4 replies
  • 0 kudos
Latest Reply
Migration_Exprt
  • 0 kudos

Great News !That's the problem we built our tool around at ITACC. It converts Oracle PL/SQL to Databricks, then compares legacy vs Databricks outputs and traces each difference to its cause. Happy to run it on one of your procedures if that's useful....

  • 0 kudos
3 More Replies
NData
by > • New Contributor
  • 178 Views
  • 2 replies
  • 1 kudos
  • 178 Views
  • 2 replies
  • 1 kudos
Latest Reply
Kashif_Inamdar
Databricks Employee
  • 1 kudos

Great question. There isn't one diagram every enterprise must follow, but there is a well-established reference pattern. Most large Databricks deployments I've worked on use some version of it. 1. Official reference architectures (start here) Databri...

  • 1 kudos
1 More Replies
anjali-1607_
by > • Visitor
  • 67 Views
  • 1 replies
  • 0 kudos

recover workspace notebooks

Hi, My study notebooks in the Databricks Community workspace were deleted from last year 2025.Is there a way to retrieve them?TIA

  • 67 Views
  • 1 replies
  • 0 kudos
Latest Reply
SumeshKashyap
Honored Contributor
  • 0 kudos

Hi @anjali-1607_ Unfortunately notebooks deleted back in 2025 can't be recovered. Deleted workspace items sit in the workspace Trash for 30 days and are then permanently purged. Community Edition has also since been retired in favour of Free Edition,...

  • 0 kudos
cristian-vasile
by > • New Contributor II
  • 60 Views
  • 0 replies
  • 0 kudos

Hybrid CSV – Self-describing .CSV files with inline schemas and hex-encoded IEEE 754 floats

Anyone who has built ingestion pipelines in Spark/Databricks knows the classic CSV headache: CSV files carry raw values, but zero context. Without an external schema definition, engines are forced to run expensive schema inference—and still risk misi...

  • 60 Views
  • 0 replies
  • 0 kudos
MouR
by > • Databricks Partner
  • 516 Views
  • 1 replies
  • 1 kudos

Palantir Foundry + Databricks: Move the Data or Just Read It?

Sometimes the cheapest migration is no migration at all.An organization has already invested in Palantir Foundry, with established pipelines, validated data, Ontology models and operational applications. Another team wants to use the same data in Dat...

palantir_1.png palantir_2.png palantir_3.png palantir_4.png
Community Articles
AzureDatabricks Palantir Federation Accenture Avanade AWSDatabricks Migration
  • 516 Views
  • 1 replies
  • 1 kudos
Latest Reply
Saurabh2310
Databricks Employee
  • 1 kudos

Useful framing. One addition from the Databricks side: if the data stays registered in Unity Catalog and Foundry reads it through virtual tables, Genie Ontology can still learn from the metric views, dashboards and queries your Databricks teams alrea...

  • 1 kudos
indradbxlearn
by > • New Contributor III
  • 62 Views
  • 0 replies
  • 0 kudos

Genie ZeroOps stuck on "Analyzing recent failures" in Free Edition, with no insights in the inbox

Genie ZeroOps became available in public beta on 19 Nov and now shows up in Databricks Free Edition. In my workspace it isn't working as expected.SetupI configured ZeroOps to monitor all jobs I own, and later added schemas.The inbox shows the status ...

indradbxlearn_0-1795331827766.png indradbxlearn_1-1795331861431.png indradbxlearn_2-1795331929575.png
  • 62 Views
  • 0 replies
  • 0 kudos
faruk
by > • Contributor II
  • 234 Views
  • 2 replies
  • 0 kudos

Lakeflow Connect – Oracle Connector vs Foreign Catalog Connector

Hi everyone,I'm currently evaluating the best approach to ingest large volumes of data from an Oracle database into Databricks.I see two possible approaches:Oracle Connector.Foreign Catalog Connector.I'd like to understand a few things:What are the m...

  • 234 Views
  • 2 replies
  • 0 kudos
Latest Reply
indradbxlearn
New Contributor III
  • 0 kudos

Hi @faruk  - You are talking about two different approaches of data ingestion which are totally different in nature:Lakeflow Connect Oracle connector: a managed ingestion pipeline that copies data into Delta. It is the log-based integrated CDC connec...

  • 0 kudos
1 More Replies
krishgarikipati
by > • Databricks Partner
  • 364 Views
  • 4 replies
  • 3 kudos

Delta Tables: Is there any possibility on Delta tables Data file formats other than Parquet

Hi Team,Since Parquet files are immutable and Delta tables framework writes data changes into new data files, Is there any option to specify any other file format and try to use same data file for minor data changes.(Below 10 Record transaction chang...

  • 364 Views
  • 4 replies
  • 3 kudos
Latest Reply
saisaranv
Contributor II
  • 3 kudos

Hi Krishna,Delta Lake tables are tightly coupled with the Parquet file format, so you cannot switch a Delta table to use a different underlying file format while retaining Delta features such as ACID transactions, time travel, and schema enforcement....

  • 3 kudos
3 More Replies
spiralmantra07
by > • New Contributor II
  • 576 Views
  • 1 replies
  • 2 kudos

How can Data Fabric streamline real-time and batch data processing for data engineering services?

Data Fabric helps data engineering teams by providing a unified architecture that integrates data across sources, automates pipeline creation, and ensures governance. It enables scalable data pipelines, efficient data warehouse management, and seamle...

  • 576 Views
  • 1 replies
  • 2 kudos
Latest Reply
saisaranv
Contributor II
  • 2 kudos

Well said. One additional consideration is workload predictability and scaling requirements.In my experience, Microsoft Fabric can be a strong choice for organizations with well-understood and relatively stable workloads, where capacity planning can ...

  • 2 kudos
tech_us
by > • New Contributor III
  • 688 Views
  • 1 replies
  • 2 kudos

How Is Databricks Accelerating AI Innovation Across Industries?

As AI adoption continues to grow, organizations are looking for scalable platforms that can support data engineering, machine learning, analytics, and generative AI workloads. Databricks has become a key part of many AI strategies by helping teams un...

  • 688 Views
  • 1 replies
  • 2 kudos
Latest Reply
saisaranv
Contributor II
  • 2 kudos

This has been my experience as well. The biggest value I've seen from Databricks is not a single capability, but the unified Lakehouse platform that brings together Data Engineering, Analytics, Machine Learning, and GenAI under a common governance mo...

  • 2 kudos
techinlayers
by > • New Contributor III
  • 1043 Views
  • 1 replies
  • 3 kudos

How I explain account vs workspace vs Unity Catalog metastore to new platform engineers

Sharing the explanation that finally stopped the same question coming back every onboarding.The account is the organisation-level container, normally one per cloud provider, and it owns billing, account admins and identities. A workspace is a single ...

  • 1043 Views
  • 1 replies
  • 3 kudos
Latest Reply
saisaranv
Contributor II
  • 3 kudos

Excellent explanation. The distinction between account, workspace, and metastore is one of the most common areas of confusion for new Databricks users, and you've broken it down in a very practical way. I especially liked the emphasis on the metastor...

  • 3 kudos
techinlayers
by > • New Contributor III
  • 557 Views
  • 1 replies
  • 1 kudos

How I explain classic vs serverless compute, and the limitation list I check before migrating a job

Sharing the two-column version I use when someone asks which compute to pick.Classic: the control plane requests VMs from your cloud provider and the cluster runs in your own account and network. You own instance types, autoscaling and networking, an...

  • 557 Views
  • 1 replies
  • 1 kudos
Latest Reply
saisaranv
Contributor II
  • 1 kudos

Great explanation. In our environment, the decision is primarily workload-driven rather than team-driven.We operate a mixed platform with:SQL analytics workloadsSpark ETL pipelines ingesting data from MongoDB, APIs, files, and other sourcesML trainin...

  • 1 kudos
SrinuB
by > • New Contributor III
  • 159 Views
  • 1 replies
  • 1 kudos

Unity Gateway: One Place to Govern Models, MCP Servers and Coding Agents

AI governance · Unity Catalog · Who can call which model, with what guardrails and at what costBy @SrinuB  in collaboration with @sridharplv A team wires an app to an external model with a key pasted into a config file. Another team lets a coding age...

blog11_unity_gateway.png
  • 159 Views
  • 1 replies
  • 1 kudos
Latest Reply
tajamulkhan
New Contributor III
  • 1 kudos

The gap you called out between the budget and the gateway usage table matters for document pipelines. If an app uses ai_parse_document on 20 PDFs and then makes model calls on the extracted text, I would check both sources before explaining the cost ...

  • 1 kudos
rubybarret656
by > • New Contributor
  • 165 Views
  • 2 replies
  • 2 kudos

Preparing for the Databricks Data Engineer Associate Exam: Which Topics Deserve the Most Practice?

Hi everyone,I'm interested in hearing how others are preparing for the Databricks Data Engineer Associate certification.One thing I've noticed while exploring the exam objectives is that understanding individual concepts is only part of the preparati...

  • 165 Views
  • 2 replies
  • 2 kudos
Latest Reply
tajamulkhan
New Contributor III
  • 2 kudos

I would spend some of that lab time on what happens when an incremental pipeline runs twice. Start with a small orders dataset, use Auto Loader to ingest it into a Bronze table and use Delta MERGE to keep one current row per order in Silver.For examp...

  • 2 kudos
1 More Replies
Brahmareddy
by > • Esteemed Contributor II
  • 124 Views
  • 1 replies
  • 1 kudos

Unity Catalog decides if an agent may write. What checks the write is right?

Agents are moving into production on Databricks. Databricks says 100,000+ agents have been built on Agent Bricks. Genie Code is an AI coding agent built for data engineering. Managed MCP servers connect agents to Unity Catalog data, and Unity Catalog...

  • 124 Views
  • 1 replies
  • 1 kudos
Latest Reply
tajamulkhan
New Contributor III
  • 1 kudos

I would add one metric beside total_moved_by: the sum of absolute changes per order. The net total can stay at zero even when an update moves money between orders.For example, say order A drops from 100 to 0 and order B rises from 0 to 100. The net c...

  • 1 kudos
Welcome to the Databricks Community!

Once you are logged in, you will be ready to post content, ask questions, participate in discussions, earn badges, and more.

Spend a few minutes exploring Get Started Resources, Learning Paths, Certifications, and Platform Discussions.

Join Learning Events here in the Community.

Connect with peers through Databricks User Groups and learn more about Community Events happening near you. We’re excited to see you get involved.

Top Kudoed Authors

Latest from our Blog

Reading Unity Catalog Tables in Snowflake

Introduction A core requirement for AI and analytics adoption is the ability to access data from multiple systems, databases, and SaaS applications without duplicating it. Multiple copies of data intr...

188Views 0kudos

Private connectivity from Databricks on AWS to Amazon S3

Table of contents Why secure connectivity mattersKey conceptsUnity Catalog Access to S3 - Authentication and PermissionsClassic compute connecting to your S3 buckets S3 gateway endpointS3 interface en...

348Views 1kudos