Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-29-2025 02:07 AM
Hi @Lumoura ,
So maybe just save the result as a csv to Volume and then use pyspark to split this file into smaller parts, i.e using repartition:
df = df.repartition(num_partitions)
