Clone the data from Prod Workspace to Test workspace

[Databricks9876]

Hi there,

I have requirement to deep clone the data from Prod workspace to Test Workspace.

I know we can do in the same workspace, but I am not aware of between workspaces.

I heard some key is needed and have some firewall issues when linking between two work spaces.

Really appreciate if someone could shed some light .

Thank you,

Rup

[Anonymous]

Hello, Rup aka @swarup muthumula​ - It's nice to meet you. Welcome to the community and thank you for bringing us this question. Let's give it a while for the members to respond. We'll come back if we need to.

[-werners-]

Can I ask what you mean by data? Is it your physical storage (data lake) or the notebooks etc?

[Databricks9876]

Hi Werners,

Thanks for your reply and Apologies for my late reply.

Yes, I am looking at physical storage. We have created tables and the data is loading through Notebooks. I don't want to run the Notebooks again in UAT, instead I want to clone the PROD data into UAT. The PROD is updated daily so whenever I need to I wan to clone those tables. We already have objects created in UAT

[Atanu]

@swarup muthumula​  are you looking for entire workspace migration ? which cloud you are in?

[Databricks9876]

Hi Atanu,

Thanks for your reply.

I am in Azure and want to just clone only data not even workspace and Notebooks

[jose_gonzalez]

Hi @swarup muthumula​ ,

Are you trying to clone Delta tables? if you do, you can use delta clone. Docs here https://docs.microsoft.com/en-us/azure/databricks/delta/delta-utility#clone-delta-table

[Databricks9876]

Thank you , Jose. Appreciate your reply.

I think the cloning is done at the same workspace level. Can we also do across workspaces? Can i Give the same clone command in another workspace by giving the location of the target table directing to Other workspace?

[Atanu · Accepted solution]

@swarup muthumula​  Azure workspace has self service migration