cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

DELTA_TXN_LOG_FAILED_INTEGRITY

ar45
New Contributor II

Hi, 

Trying to use merge statement for a query and the error comes as shown below. 

 

I am able to describe history on the table but not able to perform any operations like vaccum, restore, optimize and even merge. 

Tried dropping the external delta table and then creating the same - but this shows the same error again on creation of the table again. I understand that the delta log files seems to be corrupt but is there any way to resolve this issue?

Getting below error: 

The transaction log has failed integrity checks. Failed verification at version 4574 of: Table size (bytes) - Expected: 250827431 Computed: 556778858 Number of files - Expected: 1 Computed: 88 SQLSTATE: XXKDS

 

1 ACCEPTED SOLUTION

Accepted Solutions

mani_22
Databricks Employee
Databricks Employee

Hi @ar45 , I am not sure what caused the corruption, but to resolve the issue, you can try removing the transaction log for the corrupt version 4574 (.json file for version 4574 under the _delta_log folder). If there are .crc files for version 4574, remove those as well.

View solution in original post

2 REPLIES 2

mani_22
Databricks Employee
Databricks Employee

Hi @ar45 , I am not sure what caused the corruption, but to resolve the issue, you can try removing the transaction log for the corrupt version 4574 (.json file for version 4574 under the _delta_log folder). If there are .crc files for version 4574, remove those as well.

ar45
New Contributor II

Thank @mani_22 . Deleted entire adls folder and created the table again. This worked.

Although didn't try removing the said version. Should have tried that first. 

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now