Databricks Community

lukaszl · 01-12-2023

Hi Databricks Community, I want to set environment variables for all clusters in my workspace. The goal is to the have environment variable, available in all notebooks executed on the cluster.The environment variable is generated in global init scrip...

lukaszl · 01-16-2023

Thank you @Werner Stinckens !Based on your suggestion I found the Databricks internal file /databricks/spark/conf/spark-env.sh which is containing the environment variables visible in the notebook. Adding the new variable over this file solves my pr...

lukaszl · 01-13-2023

Thank you for the quick answer!Unfortunately, I'm going to store the dynamic access token value in that environment variable. The token need to be generated per cluster and will expire in 4 hours. So my environment variable value is known only on clu...

Databricks Community

User Stats

User Activity

Access the environment variable from the custom container base cluster

Re: Access the environment variable from the custom container base cluster

Re: Access the environment variable from the custom container base cluster