-werners-
Esteemed Contributor III

there is an easier way to see what has been processed:
SELECT * FROM cloud_files_state('path/to/checkpoint'
https://docs.databricks.com/en/ingestion/cloud-object-storage/auto-loader/production.html