cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Data Migration from SAP S/4HANA to Databricks

Pratikmsbsvm
Contributor

May someone please help me designing the Migration of SAP S/4 HANA to Databricks. How to design this. what all we need to consider as LLD.

1. How Data needs to be extracted and by which tool ? nearโ€“real-time replication is required

2. Each layer for Data flow

3. SAP Extraction

4. and if possible and any idea on how to DesignHub-and-Satellite (Hub & Spoke) architecture, central hub for harmonized SAP data models, satellites for domain-specific analytics.

Thanks a lot

2 REPLIES 2

WiliamRosa
Databricks Partner

SAP HANA SMART INTEGRATION

Wiliam Rosa
Data Engineer | Machine Learning Engineer
LinkedIn: linkedin.com/in/wiliamrosa

SteveOstrowski
Databricks Employee
Databricks Employee

Hi @Pratikmsbsvm,

Here is an updated view of the options for moving SAP S/4HANA data into Databricks, including the SAP and Databricks partnership path that is now the recommended low-friction approach. I will cover the integration options first, then the data flow layers and the Hub-and-Satellite design.

1. SAP BUSINESS DATA CLOUD CONNECT TO DATABRICKS (EVALUATE FIRST IF YOU ARE ON SAP BDC)

The most significant recent development is the SAP and Databricks partnership. If you want SAP data landing in your own Databricks workspace, the relevant product is SAP Business Data Cloud Connect to Databricks, generally available since October 2025. It shares curated SAP data products into your Databricks workspace through Delta Sharing as live, zero-copy, bidirectional data, so you can work with S/4HANA data without building a traditional extraction pipeline and without physically replicating it, and you can push results back into SAP. There is also a sibling product, SAP Databricks, which is an SAP-managed edition of Databricks embedded directly inside BDC (generally available since April 2025), for teams that want to work entirely within the SAP environment. Recent enhancements automatically sync SAP semantic metadata such as descriptions, keys, and governance tags into Unity Catalog (one direction, SAP to Databricks), so the business context travels with the data.

This path is built on Delta Sharing, an open protocol that has been generally available and in production use at scale for years, so the underlying data-movement foundation is well proven. The integration products themselves are generally available but relatively new, so if your organization is already on, or actively adopting, SAP Business Data Cloud, this is the most direct, lowest-ETL option and I would evaluate it first. For net-new or non-BDC landscapes, the SAP-certified partner extraction tools in the next sections remain the proven route.

References:
https://www.databricks.com/blog/announcing-general-availability-sap-business-data-cloud-connect-data...
https://www.databricks.com/blog/announcing-general-availability-sap-databricks-sap-business-data-clo...
https://docs.databricks.com/aws/en/delta-sharing/sap-bdc/

2. LAKEFLOW CONNECT (MANAGED INGESTION)

Lakeflow Connect provides fully managed ingestion connectors. As of today there is no dedicated SAP or S/4HANA managed extraction connector, so for classic per-table SAP extraction you would use one of the partner tools below, or the Business Data Cloud path above. The connector catalog continues to expand, with recent additions including Zendesk and Confluence, plus Public Preview query-based connectors for Oracle, Teradata, SQL Server, MySQL, MariaDB, PostgreSQL, and Lakehouse Federation, so it is worth checking the release notes periodically.

https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/

3. SAP-CERTIFIED PARTNER EXTRACTION TOOLS (NEAR REAL-TIME / CDC)

When you need classic extraction or change data capture directly from S/4HANA (ODP, BAPI, RFC, IDoc, CDS Views), these validated partners are production-proven and land data in Delta on Databricks:
- Fivetran: Databricks-validated, available via Partner Connect, SAP connectors via ODP
- Informatica Cloud Data Integration: SAP-certified, BAPI / RFC / IDoc / ODP
- Qlik (formerly Attunity): near real-time SAP change data capture
- Precisely Connect: near real-time replication from S/4HANA
- Theobald Xtract Universal and SNP Glue: lightweight, SAP-focused extraction

4. DIRECT AND DO-IT-YOURSELF EXTRACTION OPTIONS

- OData on CDS Views for a supported, semantically rich extraction interface
- JDBC direct to SAP HANA for batch pulls where appropriate
- PyRFC for custom RFC / BAPI extraction
- Landing SAP exports in cloud storage and ingesting with Auto Loader

These give you flexibility, but you own more of the engineering and operations compared with options 1 to 3.

DATA FLOW LAYERS (MEDALLION)

Regardless of the extraction method, land the data into a medallion architecture:
- Bronze: raw SAP data as ingested, or the live BDC shared tables, with minimal transformation and full history
- Silver: cleansed, conformed, deduplicated, with business keys resolved
- Gold: curated, aggregated, business-ready models for analytics and serving

Lakeflow Spark Declarative Pipelines (SDP) are a good fit for building and orchestrating these layers, with built-in data quality expectations.

HUB-AND-SATELLITE WITH UNITY CATALOG

Use Unity Catalog as the governance backbone for the Hub-and-Satellite design: a central hub catalog or schema for shared, conformed entities, with satellite schemas for domain or source-specific context. Unity Catalog gives you one permission model, end-to-end lineage, and discovery across all of it. If you use the Business Data Cloud path, the SAP governance tags and semantic metadata flow into that same model.

For near-real-time, combine CDC from option 1 or 3 with streaming or triggered SDP pipelines so the Silver and Gold layers stay current.

Happy to go deeper on any one of these.

* This reply used an agent system I built to research and draft this response based on the wide set of documentation I have available and previous memory. I personally review the draft for any obvious issues and for monitoring system reliability and update it when I detect any drift, but there is still a small chance that something is inaccurate, especially if you are experimenting with brand new features.

If this answer resolves your question, could you mark it as "Accept as Solution"? That helps other users quickly find the correct fix.