Vector index not syncing: DELTA_UNSUPPORTED_TIME_TRAVEL_BEYOND_DELETED_FILE_RETENTION_DURATION

FantineM
Visitor

Hi All,

Lately I have had issues with my vector search index not syncing.
The associated pipeline fails to create with error:

failed to resolve flow: '__online_index_view'. 
com.databricks.sql.transaction.tahoe.DeltaAnalysisException: [DELTA_UNSUPPORTED_TIME_TRAVEL_BEYOND_DELETED_FILE_RETENTION_DURATION] Cannot time travel beyond delta.deletedFileRetentionDuration (168 HOURS) set on the table.

I am guessing this means the source table for the index? This happened on an existing index which had never posed any issue. I deleted and recreated the index (7 days ago!) and now it is happening again.
If anyone has experienced the same issue and resolved, I'd appreciate any help or advice!

Thanks in advance!