Reading Multiple Data Formats

Phani1
Databricks MVP

 

Hi All,

I'm looking to develop generic code that can read multiple data formats, such as Parquet, Delta, Iceberg and save it as delta. Can you provide some insights or guidance on how to achieve this?

Regards,

Phani

Erika_Fonseca
Databricks Employee
Databricks Employee

Take a look at these 2 projects that follow a metadata-driven approach:

Lakehouse Engine

DLT Meta