ManojkMohan
Honored Contributor II

Older Databricks Runtimes (v7.x, including 7.1 LTS):

The official Databricks Runtime support lifecycle documentation specifies supported and end-of-life runtimes.

zstd Parquet support is not available for Databricks Runtime 7.1 LTS and other 7.x versions; these versions only support codecs like snappy, gzip, and lzo. Enabling zstd for Parquet in DBR 7.1 LTS will result in compatibility issues—jobs may fail to read/write such compressed files due to absent support

https://docs.databricks.com/aws/en/release-notes/runtime/

https://docs.databricks.com/aws/en/release-notes/runtime/databricks-runtime-ver

DBR Versionzstd SupportDocumentation
7.1 LTSNohttps://docs.databricks.com/aws/en/release-notes/runtime/
8.0+Yeshttps://docs.databricks.com/aws/en/release-notes/runtime/14.3lts
13.3 LTS+Yeshttps://docs.databricks.com/aws/en/release-notes/runtime/14.3lts
15.2+/15.4 LTSYeshttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/zstd_compress
16.4 LTSYeshttps://docs.databricks.com/aws/en/release-notes/runtime/