Hi @Ashwin_DSA ,

Thanks for the input. This is very helpful. For the last question, we thought about to create another table as staging, which is specifically used as trigger. Any time source has changes, we will update the staging table too. However to be strict we need to make sure the loading to source and staging are in one transaction and this is hard. Finally we gave up this. Now seems with

```

ALTER TABLE xxx SET TBLPROPERTIES (
'delta.deletedFileRetentionDuration' = 'interval 1 hours',
'delta.logRetentionDuration' = 'interval 1 hours'
)

```

The log count is reduced. The table update trigger can be initialized. And we can reset the properties back after that.