08-14-2023 02:52 PM
You can always reconfigure that and set it to higher size.
spark.driver.maxResultSize 4g --this will allocate 4GB of driver memory
