topic Re: Lake Bridge ETL Rehouse into AWS Data bricks options ? in Data Engineering

Lake Bridge ETL Rehouse into AWS Data bricks options ?

RIDBX — Fri, 08 Aug 2025 17:01:18 GMT

Lake Bridge ETL Rehouse into AWS Data bricks options ?

==========================================

Hi Community experts?

Thanks for replies to my threads.

We reviewed the Lake Bridge thread opened here. The functionality claimed, it can convert on-prem ETL (Informatica ) to data bricks notebooks and run the ETL within Cloud data bricks framework.

How does this work?

Eg Informatica artifacts on on-prem has

bash scripts (driving scripts)

Mapping

Sessions

Workflows

Scheduled jobs

How will the above INFA artifacts land/sit in Databricks framework in cloud?

INFA support heterogeneous legacy data source (Many DBs, IMF, VSAM, DB2, Unisys DB etc) connectivity/configurations.

Currently we know, we need a mechanism to land data into S3 for Data bricks to consume from S3 to load into Data bricks.

How will Lake bridge converted INFA ETL bring data from legacy data source to S3 for data bricks consumption?

Thanks for your guidance.

Re: Lake Bridge ETL Rehouse into AWS Data bricks options ?

Louis_Frolio — Fri, 08 Aug 2025 18:58:28 GMT

I encourage you to start by looking here and digging in. Lakebridge is new, so in some ways, you are going to have to be a pioneer. As more migrations are done and blogs/articles are written, you can expect prescriptive guidance from Databricks.

Cheers, Louis.

Re: Lake Bridge ETL Rehouse into AWS Data bricks options ?

RIDBX — Fri, 08 Aug 2025 21:08:40 GMT

Thanks for weighing in. For the same question in another data engineering discussion board not giving a comfort feeling about this . They project a nightmare scenarios.

Re: Lake Bridge ETL Rehouse into AWS Data bricks options ?

RIDBX — Mon, 11 Aug 2025 19:25:15 GMT

@Louis_Frolio

Is the Lakeflow Declarative Pipelines available with community edition ?

Is this part of base Databricks license or add on?

Re: Lake Bridge ETL Rehouse into AWS Data bricks options ?

Louis_Frolio — Mon, 11 Aug 2025 19:43:42 GMT

Availalbe on Community Edition: NO

If you are on Databricks Premium Edition or above then Lakeflow Pipelines is available and there is no extra charge.

Hope this helps, Louis.

Re: Lake Bridge ETL Rehouse into AWS Data bricks options ?

Louis_Frolio — Mon, 11 Aug 2025 19:44:40 GMT

Haters gonna be hating :).