Which process is eating up my driver memory?

TjommeV-Vlaio
New Contributor III

Hi,

We're running DBR 14.3 on a shared multi-node cluster.

When checking the metrics of the driver, I see that the Memory utilization and Memory swap utilization are increasing a lot and are almost never decreasing. Even if no processes are running anymore.

It seems that some processes are allocating memory, but are never releasing it.

Is there a way to detect which processes are allocating memory on the driver node?

Is there a way to detect which processes are causing the memory swap utilization on the driver node?I know these are the result of memory pressure, but it seems these are not released after a node crash and restart due to Out-of-memory (OOM)