How to change compression codec of sql warehouse written files?

alejandrofm — Fri, 21 Mar 2025 12:58:30 GMT

Hi, I'm currently starting to use SQL Warehouse, and we have most of our lake in a compression different than snappy.

How can I set the SQL warehouse to use a compression like gzip, zstd, on CREATE, INSERT, etc?

Tried this:

set spark.sql.parquet.compression.codec=gzip

And got the error:

Error running query: [_LEGACY_ERROR_TEMP_DBR_0222] org.apache.spark.sql.AnalysisException: Configuration spark.sql.parquet.compression.codec is not available.

Thanks!

Re: How to change compression codec of sql warehouse written files?

Anonymous — Fri, 16 Jun 2023 06:55:08 GMT

Hi @Alejandro Martinez

Great to meet you, and thanks for your question!

Let's see if your peers in the community have an answer to your question. Thanks.

topic How to change compression codec of sql warehouse written files? in Warehousing & Analytics

How to change compression codec of sql warehouse written files?

Re: How to change compression codec of sql warehouse written files?