The transaction log has failed integrity checks. We recommend you contact Databricks support for assistance. Failed verification at version 48 of:
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-18-2022 04:54 AM
I am trying to write data frame data into delta table. Previously it was working fine but now it is throwing "Log has failed integrity checks"
- Labels:
-
Transaction Log
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-18-2022 08:06 AM
Hi @Shanmuganathan Jothikumar , Is this happening after upgrading it to a particular DBR?
As per the error "FileSizeHistogram mismatch in file sizes
FileSizeHistogram mismatch in file counts" this needs further triage. If this keeps on happening, could you please raise a case to Databricks support.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-25-2022 09:57 PM
We didn't do any upgrade. This happened second time in a row. Last time, I dropped the table and removed all files from the path and created new table with same name due to time constraint.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-07-2022 03:51 PM
@Shanmuganathan Jothikumar I've the same exception after upgrading into unity catalog. Need to investigate a little more but adding the following setting, it works:
spark.conf.set("spark.databricks.delta.state.corruptionIsFatal", False)
