topic Re: How to capture the heap dump of the Spark driver JVM in Data Engineering https://community.databricks.com/t5/data-engineering/how-to-capture-the-heap-dump-of-the-spark-driver-jvm/m-p/18544#M12320 <P>Find the DriverDaemon</P><P></P><PRE><CODE>%sh jps</CODE></PRE><P>Take the heap dump</P><PRE><CODE>%sh jmap -dump:live,format=b,file=pbs_worker_DriverDaemon.hprof 2413</CODE></PRE><P>Copy out to download</P><PRE><CODE>%sh cp pbs_worker_DriverDaemon.hprof /dbfs/FileStore/pbs_worker_04-30-2021T15-50-00.hprof</CODE></PRE><P></P><P></P> Fri, 25 Jun 2021 22:26:29 GMT brickster_2018 2021-06-25T22:26:29Z How to capture the heap dump of the Spark driver JVM https://community.databricks.com/t5/data-engineering/how-to-capture-the-heap-dump-of-the-spark-driver-jvm/m-p/18543#M12319 Fri, 25 Jun 2021 22:24:25 GMT https://community.databricks.com/t5/data-engineering/how-to-capture-the-heap-dump-of-the-spark-driver-jvm/m-p/18543#M12319 brickster_2018 2021-06-25T22:24:25Z Re: How to capture the heap dump of the Spark driver JVM https://community.databricks.com/t5/data-engineering/how-to-capture-the-heap-dump-of-the-spark-driver-jvm/m-p/18544#M12320 <P>Find the DriverDaemon</P><P></P><PRE><CODE>%sh jps</CODE></PRE><P>Take the heap dump</P><PRE><CODE>%sh jmap -dump:live,format=b,file=pbs_worker_DriverDaemon.hprof 2413</CODE></PRE><P>Copy out to download</P><PRE><CODE>%sh cp pbs_worker_DriverDaemon.hprof /dbfs/FileStore/pbs_worker_04-30-2021T15-50-00.hprof</CODE></PRE><P></P><P></P> Fri, 25 Jun 2021 22:26:29 GMT https://community.databricks.com/t5/data-engineering/how-to-capture-the-heap-dump-of-the-spark-driver-jvm/m-p/18544#M12320 brickster_2018 2021-06-25T22:26:29Z