10-24-2025 04:56 AM
We solved this by not using pyspark and spark.sql(query) and instead using the databricks package
View solution in original post
