Hi @daniel_sahal ,

Thanks for the response:

  • cloudFiles.maxFileAge - isn't set
  • cloudFiles.backfillInterval - Will it still be worth using it even though I am not using file notification mode. Also, I have autoloader running for a live system which runs once a week and I need 100% of the data during the live streaming, what interval would you suggest? 
  •  The bad_records_path directory is empty. I would suspect a schema issue if I didn't get the data after deleting/reseting the checkpoint.

Thanks,
Boitumelo