User16826994223
Databricks Employee
Databricks Employee

You can use smaller instances with less ram than the VMs with higher ram, However there will be a trade off if there are lots of shuffle involve in the operation, because more small memory vms will increase the shuffling operation time

View solution in original post