I have a main notebook where I am setting a python variable to the name of the catalog I want to work in. I then call another notebook, using %run, which runs an insert into using a SQL command where I want to specify the catalog using the catalog variable from the main notebook. What is the best way to accomplish this? Is there a way to pass the variable to the notebook that is being called from the %run command? Should I use a widget? Should I use spark.conf?
Thanks in advance for the help.