cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Virtual network requirements inAzure (V net Injection) The VNet that you deploy your Azure Databricks workspace to must meet the following requirement...

User16826994223
Honored Contributor III

Virtual network requirements inAzure (V net Injection)

The VNet that you deploy your Azure Databricks workspace to must meet the following requirements:

  • Region: The VNet must reside in the same region as the Azure Databricks workspace.
  • Subscription: The VNet must be in the same subscription as the Azure Databricks workspace.
  • Address space: A CIDR block between /16 and /24 for the VNet and a CIDR block up to /26
  •  for the two subnets: a container subnet and a host subnet. For guidance about maximum cluster nodes based on the size of your VNet and its subnets, see Address space and maximum cluster nodes.
  • Subnets: The VNet must include two subnets dedicated to your Azure Databricks workspace: a container subnet (sometimes called the private subnet) and a host subnet (sometimes called the public subnet). However, for a workspace that uses secure cluster connectivity, both the container subnet and host subnet are private. It is unsupported to share subnets across workspaces or deploy other Azure resources on the subnets that are used by your Azure Databricks workspace. For guidance about maximum cluster nodes based on the size of your VNet and its subnets, see Address space and maximum cluster nodes.

  1. If you Create an Azure Databricks workspace using Azure portal, you can choose either to use existing subnets in the VNet or create two new subnets that you specify by names and IP ranges.
    1. If you use the All-in-one ARM template or the VNet-only ARM template, the templates create the subnets for you. In both cases, the subnets are delegated to the 
    2. Microsoft.Databricks/workspacesresource provider before workspace deployment, which allows Azure Databricks to create Network security group rules. Azure Databricks will give advance notice if we need to add or update the scope of an Azure Databricks-managed NSG rule.
    3. If you use the Workspace ARM template or a custom ARM template, it is up to you to ensure that your two subnets for the workspace use the same network security group and are properly delegated. For delegation instructions, see Upgrade your VNet Injection preview workspace to GA or Add or remove a subnet delegation.

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group