Vinay_M_R
Databricks Employee
Databricks Employee

Hi  @Mado 

Whenever we wants to display we can do cache() of that dataframe that will ensure that this particular df is cached.

And also as you mentioned once you cached new dataframe df_new, you can unpersist the earlier df after caching df_new.