Hi @Amodak91, you could use the %run magic command from within the downstream notebook and call the upstream notebook thus having it run in the same context and have all it's variables accessible including the dataframe without needing to persist it. 

Alternatively you could register a temp view on the dataframe and call the downstream notebook using the dbutils.notebook.run() method.

You could read more about this here and decide what suits better.