In Notebook, My code read and write the data to delta , My delta is partitioned by calendar_date. After the initial load i am able to read the delta file and look the data just fine.But after the second load for data for 6 month , the previous partitons are not loading normally using delta format.Reading my source delta file like this throws me error saying file dosen't exist.

    spark.read.format("delta").load("/mnt/kgaurav/table /calendar_date=2018-10-04/")

However reading like below just works fine any idea what could be wrong

spark.conf.set("spark.databricks.delta.formatCheck.enabled", "false")
 
    spark.read.format("parquet").load("/mnt/kgaurav/table/calendar_date=2018-