cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Administration & Architecture
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Do I have to choose an availability zone when creating a cluster?

User16826992666
Valued Contributor

I am worried about running out of IP's in my subnets. Is there any way to load balance across AZ's based on IP availability?

1 REPLY 1

User16826992666
Valued Contributor

If you don't want to choose an AZ at cluster creation or are worried about IP availability you can use the Automatic Availability Zone (Auto-AZ) feature. This will configure the cluster to automatically choose an AZ when the cluster starts based on the availability of IP's in the workspace subnets.

Currently this is only available through the API. But it can also be enforced with cluster policies, which would apply to clusters created through the UI if that is a requirement.

You can see more about the feature here in the documentation.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.