Hey everyone, I'm working through a project where I need to get data out of SAP S4Hana and into Databricks, and I'd love to pick the brains of anyone who's done this before.
A few things I'm trying to figure out:
- How are you actually pulling the data out? CDS views, ODP extractors, some third party connector, or a custom build?
- Are you going real time (Kafka/CDC style) or is scheduled batch working fine for your use case?
- What's bitten you the most? Schema changes breaking things, SAP getting cranky under load, latency, something else entirely?
We're dealing with decent volume on our end and really don't want to hammer the SAP source system, so reliability matters more to us than raw speed. If you've been through this, I'd really appreciate hearing what worked (and what didn't).
Thanks in advance!
