Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
I’m trying to copy a table with all it’s versions to unity catalog, I know I can use deep cloning but I want the table with the full history, is that possible?
I think if you copy the underlying files of the source table to a new location along with the _delta_log/ you effectively have the full history. Given you have external location setup for unity catalog you can then create an table on this location.
And If you are using DBX runtime 13.0+, you can use the CREATE TABLE LIKE to create a copy table on the new location.
To copy history, you would have to copy files along with the delta log folder and then create a delta table on that location
Connect with Databricks Users in Your Area
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
