cancel
Showing results for 
Search instead for 
Did you mean: 
genevive_mdonça
Databricks Employee
Databricks Employee
since ‎04-03-2023
a month ago

User Stats

  • 2 Posts
  • 0 Solutions
  • 2 Kudos given
  • 0 Kudos received

User Activity

Optimizing Shuffle Partition Size in Spark for Large Joins I am working on a Spark join between two tables of sizes 300 GB and 5 GB, respectively. After analyzing the Spark UI, I noticed the following:- The average shuffle write partition size for th...
Kudos given to