Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-13-2024 06:01 AM - edited 08-13-2024 06:02 AM
Assuming i need to perfom a groupby i.e. aggregation on a dataset stored in a delta table. If the delta table is partitioned by the field by which to group, can that have an impact on the suffling that the groupby would normally cause ?
As a connected question, one can ask is there any correlation between how a delta table is partitioned and how the data is put into the dataframe partition when loading the data ?