On OS level you will not see notebooks, you will see the mem consumption of the spark application (so this is all notebooks).
For that there is the spark ui.

I'd look for collect(), broadcast() statements. Python code outside of spark, tons of graphics/docs in notebooks (makes the notebook heavy), loops over dataframe records etc.  It all exists 😞