What is more optimized way of writing delta table in a workflow, "append" or "overwrite"?

- - Certifications
- - Learning Paths
- - Databricks Product Tours
- - Get Started Guides

- - Get Started Resources
- - Events
- - Support FAQs
- - Technical Blog
- - Community Articles
- - Announcements
- - DatabricksTV
- - Product Platform Updates

- - Private Groups
  - Princeton Life Sciences Databricks User Group
- - Skills@Scale

- - Databricks Community Innovators
- - Khoros Community Forums Support (Not for Databricks Product Questions)
- - Databricks Community Code of Conduct

Data Engineering

Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.

What is more optimized way of writing delta table in a workflow which is running every hour, "append" or "overwrite"?

1 REPLY 1

There's no "optimized way", as these are two different concepts, and depend on your use case: Overwrite removes existing data, i.e. replaces it with new data, while append adds new data to your existing table.