When I read https://docs.microsoft.com/en-us/azure/databricks/sql/admin/sql-endpoints#cluster-size, it says :
Each driver and worker has eight 128 GB Standard LRS managed disks attached. Attached disks are charged hourly.
My question is, why do each driver and worker need so much storage? What is this storage used for, technically?