topic Re: How to connect to DB2-AS400? in Data Engineering

How to connect to DB2-AS400?

Aj2 — Thu, 04 May 2023 11:00:06 GMT

What are the steps needed to connect to a DB2-AS400 source to pull data to lake using Databricks? I believe it requires establishing a jdbc connection, but I couldnot find much details online

Re: How to connect to DB2-AS400?

DrK — Fri, 05 May 2023 13:44:38 GMT

I`d start by loking what options you have for a DB2 library (probs JDBC) for python. Start here https://pypi.org/project/ibm-db/

Re: How to connect to DB2-AS400?

DrK — Fri, 05 May 2023 13:48:53 GMT

Just thinking about it, your DB2 is probably on prem. In which case you`d have to have network connectivity directly between databricks and your on-premise servers, which probably doesn`t exist. In which case, you`ll probably have to start looking at a different way of data ingress (i.e. a cloud data orchestator with an on-prem connector like AF). Without knowing what your architecture\tech stack looks like it`s difficult to say.

Re: How to connect to DB2-AS400?

shan_chandra — Wed, 10 May 2023 14:59:10 GMT

@Ajay Menon - This could be a two step process. If you are on Azure, we can retrieve the data from DB2 into a ADLS location by writing a function app using ADF. Use Autoloader to ingest the files from ADLS with CDC to a bronze delta table and follow the medallion architecture.

Re: How to connect to DB2-AS400?

Anonymous — Fri, 19 May 2023 08:08:32 GMT

Hi @Ajay Menon

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!