Yes , but partitionBy will help at some level to skip new file creation - but lets assume 90 percent data getting updated on every load and want to keep the time travel history also.