Additional info.  In Databricks 13.3, the spark variable we're provided is of type pyspark.sql.SparkSession.  In 15.4 it is created as pyspark.sql.connect.session.SparkSession (both shared clusters; it may behave differently for single node configuration).