https://community.databricks.com/t5/data-engineering/overwriting-delta-table-using-sql/m-p/25254#M17543 <P>I think you are looking for the INSERT OVERWRITE command in Spark SQL. Check out the documentation here: <A href="https://docs.databricks.com/spark/latest/spark-sql/language-manual/sql-ref-syntax-dml-insert-overwrite-table.html" target="test_blank">https://docs.databricks.com/spark/latest/spark-sql/language-manual/sql-ref-syntax-dml-insert-overwrite-table.html</A></P> Fri, 18 Jun 2021 21:35:27 GMT Ryan_Chynoweth 2021-06-18T21:35:27Z https://community.databricks.com/t5/data-engineering/overwriting-delta-table-using-sql/m-p/25253#M17542 <P>I have a delta table that is updated nightly, that I drop and recreate at the start of each day. However, this isn't ideal because every time I drop the table I lose all the info in the transaction log. Is there a way that I can do the equivalent of:</P><PRE><CODE>df.write.format('delta').mode('overwrite').save(PATH)</CODE></PRE><P>in SQL?</P> Thu, 10 Jun 2021 18:08:14 GMT https://community.databricks.com/t5/data-engineering/overwriting-delta-table-using-sql/m-p/25253#M17542 User16752241457 2021-06-10T18:08:14Z https://community.databricks.com/t5/data-engineering/overwriting-delta-table-using-sql/m-p/25254#M17543 <P>I think you are looking for the INSERT OVERWRITE command in Spark SQL. Check out the documentation here: <A href="https://docs.databricks.com/spark/latest/spark-sql/language-manual/sql-ref-syntax-dml-insert-overwrite-table.html" target="test_blank">https://docs.databricks.com/spark/latest/spark-sql/language-manual/sql-ref-syntax-dml-insert-overwrite-table.html</A></P> Fri, 18 Jun 2021 21:35:27 GMT https://community.databricks.com/t5/data-engineering/overwriting-delta-table-using-sql/m-p/25254#M17543 Ryan_Chynoweth 2021-06-18T21:35:27Z