Is it possible to mount different Azure Storage Accounts for different clusters in the same workspace?

[Bhanu1]

We have a development and a production data lake. Is it possible to have a production or development cluster access only respective mounts using init scripts?

[Hubert-Dudek · Accepted solution]

Yes it is possible. Additionally mount is permanent and done in dbfs so it is enough to run it one time.

you can have for example following configuration:

• In Azure you can have 2 databricks workspace,
• cluster in every workspace can have env variable is it DEV or PROD,
• Key vault can be common for both,
• Common repo but production/master branch in PROD,
• Common infrastructure folder which mounts folders, take settings from key vaults and depends is it DEV or PROD choose needed bucket/container

[Bhanu1]

Hi Hubert. Thanks!

Can you please show me an example for how I can use environment variables to choose a bucket/container?

[-werners-]

https://docs.databricks.com/clusters/configure.html#environment-variables

Alternatively you can also use a config file (.json, .conf, ...) which you upload to your workspace.

Depending on the environment, another container is selected.

[Kaniz]

Hi @Bhanu Patlolla​ ​, We haven’t heard from you on the last response from @Werner Stinckens​ and @Hubert Dudek​  and I was checking back to see if you have a resolution yet.

If you have any solution, please share it with the community as it can be helpful to others. Otherwise, we will respond with more details and try to help.

Also, please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.