hi..
I want to use 1 all purpose cluster and use dynamic taging in each notebook.
for example tag project and department.
I want to be able to change the tag from the notebook so I will be able to understand the costs for each project and department.
I tried spark.conf.set(spark.databricks.clusterusagetags.dep,sc)
it didn't change though when I ran my pipeline.
thanks