How to restrict the number of tasks per executor?

saipujari_spark
Databricks Employee
Databricks Employee

In general, one task per core is how spark executes the tasks.

If we want to restrict the number of tasks submitted to the executor to get more task to memory ratio, How can we achieve that?

Thanks,
Saikrishna Pujari
Sr. Spark Technical Solutions Engineer, Databricks