https://community.databricks.com/t5/data-engineering/z-order-or-partitioning-which-is-better-for-data-skipping/m-p/21684#M14815 <P>Partition pruning is the most efficient way to ensure Data skipping. However, choosing the right column for partitioning is very important. It's common to see choosing the wrong column for partitioning can cause a large number of small file problems and in such scenarios, Z-order is the preferred option. </P> Tue, 22 Jun 2021 23:19:13 GMT brickster_2018 2021-06-22T23:19:13Z https://community.databricks.com/t5/data-engineering/z-order-or-partitioning-which-is-better-for-data-skipping/m-p/21683#M14814 <P>For Delta tables, among Z-order and Partioning which is recommended technique for efficient Data Skipping</P> Tue, 22 Jun 2021 23:16:50 GMT https://community.databricks.com/t5/data-engineering/z-order-or-partitioning-which-is-better-for-data-skipping/m-p/21683#M14814 brickster_2018 2021-06-22T23:16:50Z https://community.databricks.com/t5/data-engineering/z-order-or-partitioning-which-is-better-for-data-skipping/m-p/21684#M14815 <P>Partition pruning is the most efficient way to ensure Data skipping. However, choosing the right column for partitioning is very important. It's common to see choosing the wrong column for partitioning can cause a large number of small file problems and in such scenarios, Z-order is the preferred option. </P> Tue, 22 Jun 2021 23:19:13 GMT https://community.databricks.com/t5/data-engineering/z-order-or-partitioning-which-is-better-for-data-skipping/m-p/21684#M14815 brickster_2018 2021-06-22T23:19:13Z