Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
Direct connection to SAP is time-consuming and difficult. Fivetran is Databricks partner (you can see them in Partner connect). They have an excellent way to connect Databricks to SAP:
Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.
I've connected Databricks directly to S4/HANA ABAP layers but will re-iterate that it is extremely challenging if you do not have a background in sys administration, networking, devops, programming, and SAP.
โ08-26-202311:00 AM - edited โ08-26-202311:04 AM
Can you please help me with the steps of how you connected to SAP ECC/S4? I want to connect to ECC and S4 from Databricks just to check the record count in some of the tables.
Yes, you can integrate SAP ERP with a Databricks notebook through Python. However, the process is not directly mentioned in the provided information. It would typically involve using the SAP ERP's APIs or a Python library designed to interact with SAP systems, such as pyrfc or SAPy.The data fetched from SAP ERP can then be processed and analyzed in a Databricks notebook. You can use Databricks Connect to connect your local machine to a Databricks cluster and run your Python code that interacts with the SAP system. However, it's important to note that this process involves understanding and handling the specific data models and structures used in your SAP ERP system and may require additional configuration or setup based on your particular use case and the security settings of your SAP system. Please note that the above is a general approach and may not cover all specifics or requirements you might have.
