cgrant
Databricks Employee
Databricks Employee

When you swapped back to the old checkpoint, were any records flowing through, and were batches completing? It's possible that you've accumulated a big backlog with the old checkpoint, and/or records in Kafka have expired. And the "startingOffsets" option should only affect new checkpoints/streams.