You will have to pass it as configuration and then use it in pipeline code using spark.conf.get .
and then in your pipeline notebook code you use .
demo_catalog = spark.conf.get(demo_catalog);
You will have to pass it as configuration and then use it in pipeline code using spark.conf.get .
and then in your pipeline notebook code you use .
demo_catalog = spark.conf.get(demo_catalog);