Each databricks notebook has an indepedent Scala and Python shell/REPL. Thus variables defined in one can't be shared with the other. However Temp-Views are kept within the Notebook's own spark session and thus can be shared across different language cells and is a common technique to do so