topic Re: Delta Tables copying in Data Engineering

Delta Tables copying

Anonymous — Tue, 27 Jun 2023 16:43:32 GMT

Hello,

I’m trying to copy a table with all it’s versions to unity catalog, I know I can use deep cloning but I want the table with the full history, is that possible?

Re: Delta Tables copying

menotron — Tue, 27 Jun 2023 18:59:15 GMT

I think if you copy the underlying files of the source table to a new location along with the _delta_log/ you effectively have the full history. Given you have external location setup for unity catalog you can then create an table on this location.

And If you are using DBX runtime 13.0+, you can use the CREATE TABLE LIKE to create a copy table on the new location.

Re: Delta Tables copying

bikash84 — Wed, 28 Jun 2023 00:26:29 GMT

To copy history, you would have to copy files along with the delta log folder and then create a delta table on that location