topic Re: can we update a Parquet file?? in Data Engineering

can we update a Parquet file??

kkumar — Tue, 15 Nov 2022 07:38:59 GMT

i have copied a table in to a Parquet file now can i update a row or a column in a parquet file without rewriting all the data as the data is huge.

using Databricks or ADF

Thank You

youssefmrini — Tue, 15 Nov 2022 14:31:30 GMT

You can only append Data with Parquet that's why you need to convert your parquet table to Delta. It will be much easier.

kkumar — Tue, 15 Nov 2022 14:40:15 GMT

Thank You for the reply.

True, but for a requirement, I was looking for a way to update a Parquet file.

I guess we cant.

-werners- — Wed, 16 Nov 2022 10:30:54 GMT

correct. parquet files are immutable.