We can now launch pools on databricks with different instance types.
Hybrid Pools allows customers to create clusters and select different Databricks pools for driver and workers. It provides a way to support driver vs. worker heterogeneity, and therefore, considerably increases the flexibility of Databricks pools. Some typical examples supported:
- It would allow on-demand driver and spot workers on the cluster
- It would allow a beefier driver and smaller sized workers on the cluster
- It would allow worker and drivers coming from different instance families
