https://community.databricks.com/t5/data-engineering/any-recommendations-on-instance-type-for-z-order-vacuum-optimize/m-p/22341#M15294 <P>For Delta in general having Delta cache accelerates data reads by creating copies of remote files in nodes’ local storage using a fast intermediate data format. The data is cached automatically whenever a file has to be fetched from a remote location. Successive reads of the same data are then performed locally, which results in significantly improved reading speed. And this can be useful even when performing merges where data has to be read. </P><P></P><P><A href="https://docs.databricks.com/delta/optimizations/delta-cache.html#use-delta-caching" target="test_blank">https://docs.databricks.com/delta/optimizations/delta-cache.html#use-delta-caching</A></P><P></P><P>The recommended (and easiest) way to use Delta caching is to choose a Delta Cache Accelerated—</P><P>i3&nbsp;or&nbsp;i3en&nbsp;series—worker type when you configure your cluster. Such workers are enabled and configured for Delta caching.</P> Mon, 21 Jun 2021 20:20:44 GMT aladda 2021-06-21T20:20:44Z https://community.databricks.com/t5/data-engineering/any-recommendations-on-instance-type-for-z-order-vacuum-optimize/m-p/22340#M15293 Fri, 18 Jun 2021 21:15:42 GMT https://community.databricks.com/t5/data-engineering/any-recommendations-on-instance-type-for-z-order-vacuum-optimize/m-p/22340#M15293 Anonymous 2021-06-18T21:15:42Z https://community.databricks.com/t5/data-engineering/any-recommendations-on-instance-type-for-z-order-vacuum-optimize/m-p/22341#M15294 <P>For Delta in general having Delta cache accelerates data reads by creating copies of remote files in nodes’ local storage using a fast intermediate data format. The data is cached automatically whenever a file has to be fetched from a remote location. Successive reads of the same data are then performed locally, which results in significantly improved reading speed. And this can be useful even when performing merges where data has to be read. </P><P></P><P><A href="https://docs.databricks.com/delta/optimizations/delta-cache.html#use-delta-caching" target="test_blank">https://docs.databricks.com/delta/optimizations/delta-cache.html#use-delta-caching</A></P><P></P><P>The recommended (and easiest) way to use Delta caching is to choose a Delta Cache Accelerated—</P><P>i3&nbsp;or&nbsp;i3en&nbsp;series—worker type when you configure your cluster. Such workers are enabled and configured for Delta caching.</P> Mon, 21 Jun 2021 20:20:44 GMT https://community.databricks.com/t5/data-engineering/any-recommendations-on-instance-type-for-z-order-vacuum-optimize/m-p/22341#M15294 aladda 2021-06-21T20:20:44Z