Jobs are failed with AWS_INSUFFICIENT_FREE_ADDRESSES_IN_SUBNET_FAILURE
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-18-2022 11:41 PM
We have assigned 3 dedicated subnets (one per AZ ) to the Databricks workspace each with /24 CIDR but noticed that all the jobs are running into a single subnet which causes
AWS_INSUFFICIENT_FREE_ADDRESSES_IN_SUBNET_FAILURE.
Is there a way to segregate the jobs across all the available subnets instead of using the same one all the time ?
Error Message:
Unexpected state for cluster (1217-000012-7mijsxio): AWS_INSUFFICIENT_FREE_ADDRESSES_IN_SUBNET_FAILURE(CLIENT_ERROR): aws_api_error_code:InvalidParameterValue,aws_error_message:Not enough free addresses in subnet subnet-0bd28fa8a819c24f1
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-19-2022 08:15 AM
@Mani Srini you should not get this error, if below recommendations are followed
- have you created 2 private subnets with different AZ
please re-validate Customer-managed VPC | Databricks on AWS subnets section
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-19-2022 08:47 AM
Hi, this is a failure when AWS subnet has been exhausted and there is no IP available for new services.
https://aws.amazon.com/premiumsupport/knowledge-center/subnet-insufficient-ips/
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-19-2022 10:20 PM
@karthik p Have configured one subnet per AZ(total 3). Have followed the same steps as mentioned in the document. Is there a way to check whether the Databricks uses all the subnets or not?
@Debayan Mukherjee am not getting how to use LB in this setup. Can you throw some light /share some document on how to use it on custom managed VPC.
![](/skins/images/582998B45490C7019731A5B3A872C751/responsive_peak/images/icon_anonymous_message.png)
![](/skins/images/582998B45490C7019731A5B3A872C751/responsive_peak/images/icon_anonymous_message.png)