Does it make sense to create volume at external location in dev enviroment?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2024 02:35 AM
I have create a dev resource group for databricks which includes "storage account", "access connector" and "databricks workspace". In the storage account I have created a container which is linked to the metastore. This container also contain raw data. In unity catalog enabled databricks workspace, I have create "bronze", "silver" and "gold" schema which is stored externally as well in the same container. Now, I want to create volume to access "raw" data. My question is, does it make sense to create "external" volume in this case?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-06-2024 06:26 AM
Hei, for some use cases we have created external volumes in Databricks because they needed to access them outside of Databricks and directly on the storage account, as the files had to interact with other tools.

