Clean up _delta_log files
Hello experts. We are trying to clarify how to clean up the large amount of files that are being accumulated in the _delta_log folder (json, crc and checkpoint files). We went through the related posts in the forum and followed the below:SET spark.da...
- 13928 Views
- 10 replies
- 10 kudos
Latest Reply
The distinction between `VACUUM` removing obsolete data files and checkpoint creation handling transaction log cleanup is particularly helpful. It also shows why changing retention settings alone may not be enough without new commits and checkpoints....
- 10 kudos