When sizing, this is the recommendation.
Data set Cluster Size
ITB / rows X-Large+
500GB / 1B rows X-Large
SOGB / IOOM+ rows Large
IOOGB / rows Medium
IOGB / -M rows Small
This table maps SQL endpoint cluster sizes to Databricks cluster driver sizes and worker counts. All workers are i3.2xlarge.