https://community.databricks.com/t5/data-engineering/backfill-delta-table/m-p/26218#M18327 Another approach you might consider is creating a template notebook to query a known date range with widgets. For example, two date widgets, start time and end time. Then from there you could use Databricks Jobs to update these parameters for each run, and this way it will spin up a cluster for each date range, and you could run all of those clusters in parallel as well. Mon, 07 Jun 2021 14:10:00 GMT User16783855117 2021-06-07T14:10:00Z https://community.databricks.com/t5/data-engineering/backfill-delta-table/m-p/26217#M18326 <P>What is the recommended way to backfill a delta table using a series of smaller date partitioned jobs?</P> Fri, 04 Jun 2021 19:38:34 GMT https://community.databricks.com/t5/data-engineering/backfill-delta-table/m-p/26217#M18326 Anonymous 2021-06-04T19:38:34Z https://community.databricks.com/t5/data-engineering/backfill-delta-table/m-p/26218#M18327 Another approach you might consider is creating a template notebook to query a known date range with widgets. For example, two date widgets, start time and end time. Then from there you could use Databricks Jobs to update these parameters for each run, and this way it will spin up a cluster for each date range, and you could run all of those clusters in parallel as well. Mon, 07 Jun 2021 14:10:00 GMT https://community.databricks.com/t5/data-engineering/backfill-delta-table/m-p/26218#M18327 User16783855117 2021-06-07T14:10:00Z