cancel
Showing results for 
Search instead for 
Did you mean: 
SatheesshChinnu
New Contributor III
since ‎08-27-2021
‎06-26-2023

User Stats

  • 2 Posts
  • 1 Solutions
  • 0 Kudos given
  • 0 Kudos received

User Activity

I am getting below error only during large dataset(i.e 15 TB compressed) . if my dataset is small( 1TB) i am not getting this error. Look like it fails on shuffle stage. Approx number of mappers is 150,000 Spark config:spark.sql.warehouse.dir hdfs:...