cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Migrate managed uc tables from one databricks workpace to another while retaining delta history

ajay_wavicle
Visitor

I am unable to access Databricks attached storage account due to deny assignment and hence i am unable to move the delta log from one storage account to another. How can i go around this so that i can move the delta log and data from one storage account to another.

4 REPLIES 4

Raman_Unifeye
Contributor III

@ajay_wavicle - Have you considered DEEP CLONE? Teh safest and recommended way to copy over the data and metadata together.


RG #Driving Business Outcomes with Data Intelligence

Deep clone doesnt replicate table version history. it just reduces to 1 row of version history

Raman_Unifeye
Contributor III

@ajay_wavicle - in that case, you willhave to do it from a notebook using dbutils command.

Map the new storage account as an external location to be accessed by old workspace.

Then use dbutils.fs.cp like below with a recursive true option.

dbutils.fs.cp("dbfs:/user/hive/warehouse/old_table/", "abfss://container@new_storage.dfs.core.windows.net/new_table/", recurse=True)

 


RG #Driving Business Outcomes with Data Intelligence

getting error for managed uc tables copy. Please see attached Screenshot