- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-14-2025 06:59 AM
Hello @fishingrod,
Yes, the cluster size of a Serverless Warehouse can automatically scale up and down. The autoscaling behavior is managed by Intelligent Workload Management (IWM), which dynamically adjusts the compute resources based on the workload demands. This system uses machine learning models to predict the resource needs of incoming queries and monitors the warehouse’s available compute capacity in real time.
The number of workers used when executing queries is not fixed. Instead, the system scales the number of resources to accommodate varying demands. The autoscaling mechanism ensures that compute resources are rapidly upscaled to maintain low latency and quickly downscaled to minimize costs when demand is low. This dynamic management allows the warehouse to handle large numbers of queries efficiently and cost-effectively.
Please see: https://docs.databricks.com/en/compute/sql-warehouse/warehouse-behavior.html