Flex nodes

fkseki
Contributor

Databricks REST API docs of instance pool editing states it supports the node_type_flexibility object but I couldn't make it work. I get a 200 response but when getting the instance pool information the alternate node type is not present. Does anyone know how to edit an instance pool in order to define an alternate node type?

 

Here's what I tried passing on the request body

{
"instance_pool_id": "<instance_pool_id>",
"instance_pool_name": "DeadPool",
"min_idle_instances": 0,
"node_type_id": "Standard_D8as_v5",
"node_type_flexibility": {
    "alternate_node_type_ids": [
      "Standard_D8as_v4", "Standard_D8as_v3"
    ]
  },
"idle_instance_autotermination_minutes": 5,
"enable_elastic_disk": true,
"azure_attributes": {
"availability": "ON_DEMAND_AZURE"
}
}

If the instance pool is created with the node_type_flexibility, it's configuration comes on the request, but I'm still unable to edit it's list of alternate node types

Am I doing something wrong or is the documentation wrong?