I have 1 delta table that I continuously append events into, and a 2nd delta table that I continuously merge into (streamed from the 1st table) that has unique ID's where properties are updated from the events (An ID represents a unique thing that gets many events). The actual data size of the 2nd table is ≈ 400MB, however due to delta versions it consumes ≈ 40GB. I have added vacuum every hour to the streaming process to keep it even this low. Any suggestions on how I can reduce this storage consumption further? I do not require the versioning. Ideally I could have some way to disable this while retaining the ability to MERGE.
