Creating a test schema - what is the best practice?

Asterol — Mon, 24 Jul 2023 07:00:45 GMT

Hey,

I've created a schema with few tables with historical data (prod), now I would like to have a Dev/testing environment with exactly the same data.

What do you recommend? CTAS? Shallow clone? Deep clone? I wonder if shallow clone would be sufficient, what is your experience?

Re: Creating a test schema - what is the best practice?

Tharun-Kumar — Tue, 25 Jul 2023 05:17:39 GMT

@Asterol

If you would like to have the same data for your Dev/testing environment, I would recommend using Deep Clone. Deep clone copies the metadata and creates an independent copy of the table data.

Shallow clone only copies the metadata and will have a pointer to your production data. Shallow clone only helps for short-lived use cases.

If you end goal is to create a Dev/testing/production environment, Deep Clone is the way forward. This would help you in using and maintaining them independently.

topic Re: Creating a test schema - what is the best practice? in Data Engineering

Creating a test schema - what is the best practice?

Re: Creating a test schema - what is the best practice?