@Shanmuganathan Jothikumar​ I've the same exception after upgrading into unity catalog. Need to investigate a little more but adding the following setting, it works:

spark.conf.set("spark.databricks.delta.state.corruptionIsFatal", False)