cancel
Showing results for 
Search instead for 
Did you mean: 
saipujari_spark
Valued Contributor
Valued Contributor
since ‎09-01-2021
‎01-11-2024

User Stats

  • 19 Posts
  • 7 Solutions
  • 18 Kudos given
  • 15 Kudos received

User Activity

In general, one task per core is how spark executes the tasks.If we want to restrict the number of tasks submitted to the executor to get more task to memory ratio, How can we achieve that?
When streaming to a Delta table, both repartitioning on the partition column and optimized write can help to avoid small files.Which is recommended between Delta Optimized Write vs Repartitioning?