cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Does it make sense to create volume at external location in dev enviroment?

hpant1
New Contributor III

I have create a dev resource group for databricks which includes "storage account", "access connector" and "databricks workspace". In the storage account I have created a container which is linked to the metastore. This container also contain raw data. In unity catalog enabled databricks workspace, I have create "bronze", "silver" and "gold" schema which is stored externally as well in the same container. Now, I want to create volume to access "raw" data. My question is, does it make sense to create "external" volume in this case?

1 REPLY 1

antonuzzo96
New Contributor III

Hei, for some use cases we have created external volumes in Databricks because they needed to access them outside of Databricks and directly on the storage account, as the files had to interact with other tools.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group