cluster nodes unavailable scenarios
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-11-2023 06:35 AM
Concerning job cluster configuration, I'm trying to figure out what happens if AWS node type availability is smaller than the minimum number of workers specified in the configuration json (either availabilty<num_workers or, for autoscaling, availabilty<min_workers).
Seeking insights into both scenarios:
- Low availability at cluster start
- Availability drop while computation is already in progress
Will the cluster start/continue computation? Wait? Fail?
Are there configurations to tweak related cluster behavior?
thanks!
