I have the following command that runs in my databricks notebook.spark.conf.get("spark.databricks.clusterUsageTags.managedResourceGroup")I have wrapped this command into a function (simplified).def get_info():
return spark.conf.get("spark.databri...
Thanks for your reply.I have redefined the function, including spark in the scope:def get_info(spark: SparkSession):
return spark.conf.get("spark.databricks.clusterUsageTags.managedResourceGroup")After implementing the change, it works.Hence, tha...
