topic Re: The transaction log has failed integrity checks. We recommend you contact Databricks support for assistance. Failed verification at version 48 of: in Data Engineering

The transaction log has failed integrity checks. We recommend you contact Databricks support for assistance. Failed verification at version 48 of:

Shan3009 — Tue, 18 Oct 2022 11:54:19 GMT

I am trying to write data frame data into delta table. Previously it was working fine but now it is throwing "Log has failed integrity checks"

Re: The transaction log has failed integrity checks. We recommend you contact Databricks support for assistance. Failed verification at version 48 of:

Shan3009 — Wed, 26 Oct 2022 04:57:44 GMT

We didn't do any upgrade. This happened second time in a row. Last time, I dropped the table and removed all files from the path and created new table with same name due to time constraint.

Re: The transaction log has failed integrity checks. We recommend you contact Databricks support for assistance. Failed verification at version 48 of:

jcasanella — Mon, 07 Nov 2022 23:51:45 GMT

@Shanmuganathan Jothikumar I've the same exception after upgrading into unity catalog. Need to investigate a little more but adding the following setting, it works:

spark.conf.set("spark.databricks.delta.state.corruptionIsFatal", False)

Re: The transaction log has failed integrity checks. We recommend you contact Databricks support for assistance. Failed verification at version 48 of:

Debayan — Tue, 18 Oct 2022 15:06:52 GMT

Hi @Shanmuganathan Jothikumar , Is this happening after upgrading it to a particular DBR?

As per the error "FileSizeHistogram mismatch in file sizes

FileSizeHistogram mismatch in file counts" this needs further triage. If this keeps on happening, could you please raise a case to Databricks support.