• Databricks Community
  • Get Started Discussions
  • Re: RDD Issue in Unity Catalog

iakshaykr
iakshaykr
New Contributor III
Options
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Report Inappropriate Content

‎07-14-2024 06:08 AM

@sambgp Chekc this if this can help 

https://stackoverflow.com/questions/45873155/out-of-memory-error-when-collecting-data-out-of-spark-c... ; https://stackoverflow.com/questions/26562033/how-to-set-apache-spark-executor-memory ; https://community.databricks.com/t5/data-engineering/executor-memory-increase-limitation-based-on-no... to increase the memory and maxResultSize for drive and executor . 

0 Kudos
Reply
Powered by Khoros