How can I make a cluster start up in the availability-zone (AZ) with the most available IPs?

[User16776431030]

I see the default in the UI is to always create clusters in a single AZ (e.g. us-west-2a), but want to distribute workloads across all available AZs.

[User16776431030 · Accepted solution]

Found the answer - not available in the UI, but via API, you can submit the cluster definition with

"aws_attributes": {
    "zone_id": "auto"
  },

This is documented in the Cluster API: https://docs.databricks.com/dev-tools/api/latest/clusters.html#awsattributes