cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Efficient methods to make a temporary copy of a table

phguk
New Contributor III

I'm using a tool (SAS) that doesn't inherently support time travel - that's to say it doesn't generate SQL including Timestamp or Version (for example). An obvious work-around could be to first copy/clone the version of the table, which SAS can then work on (let's assume SAS only needs read access). 

My question is: what's the most efficient approach to accomplish this ? For example you could build a view rather than copy the table. Alternatively, I don't suppose there is an alias-like feature where you can temporarily give a new name to a given version of the table ?

Thanks in advance, Paul

2 REPLIES 2

daniel_sahal
Esteemed Contributor

@phguk 
I think that Shallow Clone would be the best solution here.

phguk
New Contributor III

Thanks for this suggestion. I've scanned the on-line docs but confess I still don't understand the difference between a view (unmaterialized) and a shallow clone. Docs say shallow clone should be cheaper. But why ? How about performance too ?  I'd love to see a table comparing these approaches. Any insight you can share is appreciated. Of course an even better (theoretical) approach would be to allow an alias to be created for the table which simply hides the fact that it's a specific version of the table 😉  Tx Paul

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group