https://community.databricks.com/t5/data-engineering/delta-vs-parquet/m-p/24756#M17233 <P>I'm curious about the benefits of using the Delta file format vs. Parquet. Is there any downside to using Delta?</P> Mon, 14 Jun 2021 20:21:50 GMT User16826992185 2021-06-14T20:21:50Z https://community.databricks.com/t5/data-engineering/delta-vs-parquet/m-p/24756#M17233 <P>I'm curious about the benefits of using the Delta file format vs. Parquet. Is there any downside to using Delta?</P> Mon, 14 Jun 2021 20:21:50 GMT https://community.databricks.com/t5/data-engineering/delta-vs-parquet/m-p/24756#M17233 User16826992185 2021-06-14T20:21:50Z https://community.databricks.com/t5/data-engineering/delta-vs-parquet/m-p/24757#M17234 <P>Not really. You get upsides like transactions, time travel, upsert/merge/deletes. There is some cost to that, as Delta manages that by writing and managing many smaller Parquet files and has to re-read them to recreate the current or past state of the data. VACUUMing the data set periodically takes time too. So you may incur a little runtime overhead for these reasons; then again, Delta offers advanced features like z-order indexing and data skipping with Spark that also make it faster to read than Parquet.</P> Thu, 17 Jun 2021 23:17:18 GMT https://community.databricks.com/t5/data-engineering/delta-vs-parquet/m-p/24757#M17234 sean_owen 2021-06-17T23:17:18Z