topic DELTA_TXN_LOG_FAILED_INTEGRITY in Data Engineering

DELTA_TXN_LOG_FAILED_INTEGRITY

ar45 — Fri, 16 May 2025 09:41:21 GMT

Hi,

Trying to use merge statement for a query and the error comes as shown below.

I am able to describe history on the table but not able to perform any operations like vaccum, restore, optimize and even merge.

Tried dropping the external delta table and then creating the same - but this shows the same error again on creation of the table again. I understand that the delta log files seems to be corrupt but is there any way to resolve this issue?

Getting below error:

The transaction log has failed integrity checks. Failed verification at version 4574 of: Table size (bytes) - Expected: 250827431 Computed: 556778858 Number of files - Expected: 1 Computed: 88 SQLSTATE: XXKDS

Re: DELTA_TXN_LOG_FAILED_INTEGRITY

mani_22 — Sun, 18 May 2025 12:49:59 GMT

Hi @ar45 , I am not sure what caused the corruption, but to resolve the issue, you can try removing the transaction log for the corrupt version 4574 (.json file for version 4574 under the _delta_log folder). If there are .crc files for version 4574, remove those as well.

Re: DELTA_TXN_LOG_FAILED_INTEGRITY

ar45 — Tue, 20 May 2025 07:36:37 GMT

Thank @mani_22 . Deleted entire adls folder and created the table again. This worked.

Although didn't try removing the said version. Should have tried that first.