06-24-2021 04:59 PM
You can set the configurations on the Databricks cluster UI
https://docs.databricks.com/clusters/configure.html#spark-configuration
To see the default configuration, run the below code in a notebook:
%sql set;
