Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-14-2022 05:32 AM
@Cheuk Hin Christophe Poon
Well, I don't have any decent idea besides check why this happening, Maybe like you said - the transpose require to collect all the data into driver, maybe you can find valuable information in the spark UI.
Hope you will solve this problem, but its really sound weird that you need 128GB machine to transpose 2 GB matrix.