While using deltalake for eventing system, with repeated updates and merges etc, we are using deletion vector to improve performance. With that comes "REORG TABLE" maintenance task.
My question is in a ingestion and extract heavy system, when we conduct sequence of REORG TABLE -> OPTIMIZE -> VACUUM tasks, is there any impact of it on event-data ingestion into deltalake, and also correspondingly is there any impact on data extraction from deltalake?
Are we expected to pause/backoff ingestion and data extract while REORG TABLE->OPTIMIZE->VACUUM is in progress, considering REORG TABLE is essentially partition rewrites excluding soft-deleted data from a partition?
We are using delta 3.2 version, spark 3.5
