cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

uidance Required for Informatica to Databricks Workflow Migration Using AI

chirag_nagar
New Contributor

Hi Team,

I am currently exploring approaches to convert Informatica PowerCenter workflows into Databricks-compatible code using AI capabilities. As part of this effort, I would like to highlight that Informatica generates individual XML files for each workflow and mapping, and multiple mappings are often used within a single workflow.

I would appreciate any guidance or suggestions on how this migration can be effectively achieved.

Thank you in advance for your support.

Best regards,
Chirag Nagar

1 ACCEPTED SOLUTION

Accepted Solutions

BigRoux
Databricks Employee
Databricks Employee

Greetings @chirag_nagar , as you can imagine or know, migrations are extremely complex and time consuming.  There are a few approaches to migrations but I want to focus on one - Bladebridge.  This is a free tool provided by Databricks that is AI powered and desginged to help mitigate some of the challenges faced with migrations.

Here are some facts and helpful tips when using Bladebridge:

 

  • Bladebridge Informatica PC Converter: This is a leading tool developed jointly by Databricks and Bladebridge for migrating Informatica PowerCenter workflows and mappings. It automates:

    • Mapping Conversion: Converts PowerCenter mappings exported as XML to Databricks Notebooks.
    • Session Configuration: Migrates session-level settings into Databricks-compatible equivalents.
    • Workflow Management: Translates PowerCenter workflows to Airflow DAGs or Databricks Jobs.

    Typical automation rates are high—between 80% and 95% of code conversion—depending on the complexity and how standardized the mappings/patterns are.

  • Configurable Automation: Bladebridge tooling allows externalized configuration—users can fine-tune conversion rules during migration to increase automation coverage. Manual intervention is recommended for unique or infrequent patterns.

  • Informatica’s Intelligent Data Management Cloud (IDMC): If modernizing to Informatica’s cloud, assets and business logic from PowerCenter can be reused nearly completely. This can then connect to Databricks, leveraging pushdown execution for high performance, and integrating with Databricks native governance features (Unity Catalog).

Here are some key features of Bladbridge (generalized):


Rule-Based Deterministic Conversion: BladeBridge employs a rule-based approach that makes conversions deterministic and bulletproof, providing customers with predictable migration outcomes . The platform uses a configuration-driven approach that allows customers to retain full ownership of conversion patterns and update configurations as requirements evolve .


Multi-Platform Support: The technology automates migration from legacy systems including Microsoft SQL Server, Oracle, Teradata, Snowflake, Amazon Redshift, and supports migrations from over 20 enterprise data warehouses and ETL tools including Informatica and IBM DataStage .


Iterative Process: BladeBridge uses an iterative conversion process where failed unit tests trigger automatic configuration file adaptations until errors are resolved . This approach ensures migration reliability and reduces risk.

Helpful Links to learn more about Bladebridge:

https://www.databricks.com/blog/introducing-lakebridge-free-open-data-migration-databricks-sql

https://www.databricks.com/company/newsroom/press-releases/databricks-acquires-bladebridge-technolog...

https://abylon.io/blog/lakebridge-from-databricks-simpler-and-faster-data-warehouse-migration/

https://www.databricks.com/blog/introducing-lakebridge-free-open-data-migration-databricks-sql

 

Hope this helps, Louis.

 

 

View solution in original post

1 REPLY 1

BigRoux
Databricks Employee
Databricks Employee

Greetings @chirag_nagar , as you can imagine or know, migrations are extremely complex and time consuming.  There are a few approaches to migrations but I want to focus on one - Bladebridge.  This is a free tool provided by Databricks that is AI powered and desginged to help mitigate some of the challenges faced with migrations.

Here are some facts and helpful tips when using Bladebridge:

 

  • Bladebridge Informatica PC Converter: This is a leading tool developed jointly by Databricks and Bladebridge for migrating Informatica PowerCenter workflows and mappings. It automates:

    • Mapping Conversion: Converts PowerCenter mappings exported as XML to Databricks Notebooks.
    • Session Configuration: Migrates session-level settings into Databricks-compatible equivalents.
    • Workflow Management: Translates PowerCenter workflows to Airflow DAGs or Databricks Jobs.

    Typical automation rates are high—between 80% and 95% of code conversion—depending on the complexity and how standardized the mappings/patterns are.

  • Configurable Automation: Bladebridge tooling allows externalized configuration—users can fine-tune conversion rules during migration to increase automation coverage. Manual intervention is recommended for unique or infrequent patterns.

  • Informatica’s Intelligent Data Management Cloud (IDMC): If modernizing to Informatica’s cloud, assets and business logic from PowerCenter can be reused nearly completely. This can then connect to Databricks, leveraging pushdown execution for high performance, and integrating with Databricks native governance features (Unity Catalog).

Here are some key features of Bladbridge (generalized):


Rule-Based Deterministic Conversion: BladeBridge employs a rule-based approach that makes conversions deterministic and bulletproof, providing customers with predictable migration outcomes . The platform uses a configuration-driven approach that allows customers to retain full ownership of conversion patterns and update configurations as requirements evolve .


Multi-Platform Support: The technology automates migration from legacy systems including Microsoft SQL Server, Oracle, Teradata, Snowflake, Amazon Redshift, and supports migrations from over 20 enterprise data warehouses and ETL tools including Informatica and IBM DataStage .


Iterative Process: BladeBridge uses an iterative conversion process where failed unit tests trigger automatic configuration file adaptations until errors are resolved . This approach ensures migration reliability and reduces risk.

Helpful Links to learn more about Bladebridge:

https://www.databricks.com/blog/introducing-lakebridge-free-open-data-migration-databricks-sql

https://www.databricks.com/company/newsroom/press-releases/databricks-acquires-bladebridge-technolog...

https://abylon.io/blog/lakebridge-from-databricks-simpler-and-faster-data-warehouse-migration/

https://www.databricks.com/blog/introducing-lakebridge-free-open-data-migration-databricks-sql

 

Hope this helps, Louis.