cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
ramz
New Contributor II
since ‎03-07-2023
‎06-26-2023

User Stats

  • 2 Posts
  • 0 Solutions
  • 1 Kudos given
  • 0 Kudos received

User Activity

High driver memory usage on loading parquet file

03-07-2023
Hi, I am using pyspark and i am reading a bunch of parquet files and doing the count on each of them. Driver memory shoots up about 6G to 8G. My setup:I have a cluster of 1 driver node and 2 worker node (all of them 16 core 128 GB RAM). This is th...
Kudos given to
View all