What is the use-case for local-ssd's in databricks clusters? I noticed some clusters have many Tb's worth and some have no local ssd's.
What are the pro's and con's of changing the disk size bigger and smaller?
According to the docs:
> The disk cache is configured to use at most half of the space available on the local SSDs provided with the worker nodes. For configuration options, see Configure the disk cache.
But what is the other half used for? Is it swap? Sorting tempfiles written during execution.
