Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-31-2023 03:29 AM
in the history of the delta table you can see how many files have been rewritten (in the operation metrics column).
There are statistics like numtargetfilesadded and numtargetfilesremoved etc.
The fact that your source dataframe (so the incoming data) has 8 partitions, does not mean that the delta lake table also will update 8 partitions.