https://community.databricks.com/t5/data-engineering/what-is-the-best-practice-of-deleting-the-complete-data-from/m-p/19167#M12820 <P>It's recommended to use the overwrite option. Overwrite the table data and run a VACUUM command.&nbsp;</P><P></P><UL><LI>To Delete the data from a Managed Delta table, the DROP TABLE command can be used.&nbsp;</LI><LI>If it's an external table, then run a DELETE query on the table and then execute VACUUM with RETAIN HOURS 0</LI><LI>CREATE or REPLACE table can also be used</LI><LI><B>We do not recommend deleting the files from the underlying storage directly. That can cause issues with the transaction logs</B></LI></UL> Fri, 25 Jun 2021 17:53:28 GMT brickster_2018 2021-06-25T17:53:28Z https://community.databricks.com/t5/data-engineering/what-is-the-best-practice-of-deleting-the-complete-data-from/m-p/19166#M12819 <P>I have a use case where I need to delete the data completely and load new data to the existing Delta table.&nbsp;</P><P></P> Fri, 25 Jun 2021 17:51:58 GMT https://community.databricks.com/t5/data-engineering/what-is-the-best-practice-of-deleting-the-complete-data-from/m-p/19166#M12819 brickster_2018 2021-06-25T17:51:58Z https://community.databricks.com/t5/data-engineering/what-is-the-best-practice-of-deleting-the-complete-data-from/m-p/19167#M12820 <P>It's recommended to use the overwrite option. Overwrite the table data and run a VACUUM command.&nbsp;</P><P></P><UL><LI>To Delete the data from a Managed Delta table, the DROP TABLE command can be used.&nbsp;</LI><LI>If it's an external table, then run a DELETE query on the table and then execute VACUUM with RETAIN HOURS 0</LI><LI>CREATE or REPLACE table can also be used</LI><LI><B>We do not recommend deleting the files from the underlying storage directly. That can cause issues with the transaction logs</B></LI></UL> Fri, 25 Jun 2021 17:53:28 GMT https://community.databricks.com/t5/data-engineering/what-is-the-best-practice-of-deleting-the-complete-data-from/m-p/19167#M12820 brickster_2018 2021-06-25T17:53:28Z