topic Re: Delta Table Properties in Data Engineering

Delta Table Properties

ramdasp1 — Tue, 06 Aug 2024 20:16:06 GMT

When I look at the properties of a delta table I see these two properties that are set to a value of 1.

I went through the manual for these properties and this is what the manual says.

delta.minReaderVersion: The minimum required protocol reader version for a reader that allows to read from this Delta table.

delta.minWriterVersion: The minimum required protocol writer version for a writer that allows to write to this Delta table.

I did not understand the above explanation. Can someone simplify it for me, Please.

Kind Regards

Re: Delta Table Properties

szymon_dybczak — Tue, 06 Aug 2024 20:24:06 GMT

Those properties indicates information about backwards compatibility for reader/writer interface in Delta.

Delta Lake guarantees backward compatibility. A higher protocol version of the Delta Lake reader is always able to read data that was written by a lower protocol version.

You can find more detailed explanation below:

https://docs.delta.io/2.0.2/versioning.html

Re: Delta Table Properties

Retired_mod — Thu, 08 Aug 2024 06:43:14 GMT

Hi @ramdasp1, Thanks for reaching out! Please review the response and let us know if it answers your question. Your feedback is valuable to us and the community.

If the response resolves your issue, kindly mark it as the accepted solution. This will help close the thread and assist others with similar queries.

We appreciate your participation and are here if you need further assistance!

Re: Delta Table Properties

CPRP — Wed, 14 Aug 2024 22:26:50 GMT

I dont see any option to mark it as the accepted solution.

Please go ahead and mark it for me (if possible).

Re: Delta Table Properties

Brahmareddy — Wed, 14 Aug 2024 23:04:24 GMT

Hi Ramdas1,

Let me explain you in simple terms with an example.

A Delta table is like a special book for data. delta.minReaderVersion is the minimum version of the "reader" you need to open and read the book, while delta.minWriterVersion is the minimum version of the "pen" needed to add or change pages. Both set to 1 means any basic tool can read and write to the table, making it widely compatible.

Thanks,

Brahma