How to change compression codec of sql warehouse written files?

[alejandrofm]

Hi, I'm currently starting to use SQL Warehouse, and we have most of our lake in a compression different than snappy.

How can I set the SQL warehouse to use a compression like gzip, zstd, on CREATE, INSERT, etc?

Tried this:

set spark.sql.parquet.compression.codec=gzip

And got the error:

Error running query: [_LEGACY_ERROR_TEMP_DBR_0222] org.apache.spark.sql.AnalysisException: Configuration spark.sql.parquet.compression.codec is not available.

Thanks!

[Anonymous]

Hi @Alejandro Martinez​ 

Great to meet you, and thanks for your question!

Let's see if your peers in the community have an answer to your question. Thanks.