Additional info. In Databricks 13.3, the spark variable we're provided is of type pyspark.sql.SparkSession. In 15.4 it is created as pyspark.sql.connect.session.SparkSession (both shared clusters; it may behave differently for single node configura...
@Retired_mod I am also running into this issue, also with Great Expectations as it happens. I have also tried using the read paquert like you suggested and am still getting the problematic format. Is it possible to direct Databricks to create one t...
