Databricks Community

blobbles78 · 12-10-2024

I have a Personal cluster version 15.4 LTS (includes Apache Spark 3.5.0, Scala 2.12) and a SQL Warehouse in a databricks environment. When I use the following code to create a table in a catalog, it gives me different column types when run on the cl...

blobbles78 · 12-11-2024

Yes, that seems to work! So in order to get the same behaviour for our clusters compared to our SQL Warehouse, we have to ensure the spark setting spark.sql.ansi.enabled=true? That seems like a setting that should default to be true, is there a reaso...

blobbles78 · 12-11-2024

I have tried with Databricks Runtimes of 14.3 and 16.0 with the same results. I wouldn't like to use anything prior to 14.3, so don't want to try earlier versions. Remember the computes all support the coalesce, its just that using it with a DBR ins...

Databricks Community

User Stats

User Activity

SQL run on cluster creates table different to SQL Warehouse endpoint

Re: SQL run on cluster creates table different to SQL Warehouse endpoint

Re: SQL run on cluster creates table different to SQL Warehouse endpoint