https://community.databricks.com/t5/machine-learning/which-file-size-is-better-1-gb-file-size-in-target-or-128-mb-or/m-p/23227#M1316 <P>If data is getting appended primarily to the delta table and read ratio is higher than writes ratio - larger file sizes ( 1GB) would be ideal. </P><P></P><P>However, if your delta table undergoes frequent upserts/merges, having smaller files than the default 1GB can improve MERGE performance as only smaller amounts of data would have to be rewritten.</P><P></P><P>Check out file size auto tuning for MERGE as well </P> Wed, 23 Jun 2021 05:35:26 GMT sajith_appukutt 2021-06-23T05:35:26Z https://community.databricks.com/t5/machine-learning/which-file-size-is-better-1-gb-file-size-in-target-or-128-mb-or/m-p/23226#M1315 <P>Which file size is better 1 GB file size in target or 128 MB or lesser than that&nbsp;, I am interested in knowing concept too.</P> Thu, 17 Jun 2021 15:05:07 GMT https://community.databricks.com/t5/machine-learning/which-file-size-is-better-1-gb-file-size-in-target-or-128-mb-or/m-p/23226#M1315 User16826994223 2021-06-17T15:05:07Z https://community.databricks.com/t5/machine-learning/which-file-size-is-better-1-gb-file-size-in-target-or-128-mb-or/m-p/23227#M1316 <P>If data is getting appended primarily to the delta table and read ratio is higher than writes ratio - larger file sizes ( 1GB) would be ideal. </P><P></P><P>However, if your delta table undergoes frequent upserts/merges, having smaller files than the default 1GB can improve MERGE performance as only smaller amounts of data would have to be rewritten.</P><P></P><P>Check out file size auto tuning for MERGE as well </P> Wed, 23 Jun 2021 05:35:26 GMT https://community.databricks.com/t5/machine-learning/which-file-size-is-better-1-gb-file-size-in-target-or-128-mb-or/m-p/23227#M1316 sajith_appukutt 2021-06-23T05:35:26Z