Thanks for the detailed analysis.

My scenario is like same base dataframe with 2 lakh unique records goes through the entire notebook traversing through 10-15 joins with tables around 1-5 billion records each.

so it might take time intially to get the list variable populated. But i can reuse the same list in 10-15 joins only if this really improves the performance.