Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-30-2022 01:30 AM
Hi,
In my experience, if you use dropDuplicates(), Spark will keep a random row.
Therefore, you should define a logic to remove duplicated rows.
