topic Auto Loader Schema-Inference and Evolution for parquet files in Data Engineering

Auto Loader Schema-Inference and Evolution for parquet files

Gapy — Sun, 31 Oct 2021 13:43:09 GMT

Dear all,

will (and when) will Auto Loader also support Schema-Inference and Evolution for parquet files, at this point it is only for JSON and CSV supported if i am not mistaken?

Thanks and regards,

Gapy

Re: Auto Loader Schema-Inference and Evolution for parquet files

Sandeep — Wed, 10 Nov 2021 15:46:01 GMT

@Gasper Zerak , This will be available in near future (DBR 10.3 or later). Unfortunately, we don't have an SLA at this moment.