topic All-purpose compute clusters that are attached to a pool are no longer able to switch to a different pool/change to a non-pool worker/driver. in Data Engineering

All-purpose compute clusters that are attached to a pool are no longer able to switch to a different pool/change to a non-pool worker/driver.

JoeWMP — Fri, 11 Nov 2022 20:39:38 GMT

Would like to know if anyone else is experiencing this - we're seeing this across 5+ different Databricks workspaces in both AWS and Azure.

Reproduction:

Create all purpose compute cluster, attach it to existing pool, save and start cluster.

Edit cluster, change pool or change to a instance type worker and driver, click "Confirm". Notice that changes weren't applied.

Specific instance configuration we used:

Re: All-purpose compute clusters that are attached to a pool are no longer able to switch to a different pool/change to a non-pool worker/driver.

JoeWMP — Fri, 11 Nov 2022 20:52:16 GMT

We're also seeing the same behavior when trying to change the pool on an all-purpose cluster using Terraform and Databricks Labs Terraform provider as well. The Terraform apply will go through and say the cluster was updated to the new pool id, but the changes have not actually been applied.