โ03-14-2022 02:51 PM
We have a development and a production data lake. Is it possible to have a production or development cluster access only respective mounts using init scripts?
โ03-14-2022 03:25 PM
Yes it is possible. Additionally mount is permanent and done in dbfs so it is enough to run it one time.
you can have for example following configuration:
โ03-14-2022 03:25 PM
Yes it is possible. Additionally mount is permanent and done in dbfs so it is enough to run it one time.
you can have for example following configuration:
โ03-14-2022 03:34 PM
Hi Hubert. Thanks!
Can you please show me an example for how I can use environment variables to choose a bucket/container?
โ03-15-2022 12:28 AM
https://docs.databricks.com/clusters/configure.html#environment-variables
Alternatively you can also use a config file (.json, .conf, ...) which you upload to your workspace.
Depending on the environment, another container is selected.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group