cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Are there implications moving Managed Table, and mounting as External.

JohnB
New Contributor II

The scenario is "A substaincial amount of data needs to be moved from a legacy Databricks that has Managed Tables, to a new E2 Databrick. The new bucket will be a dedicated Datalake rather than the Workspace Bucket so they will be External Tables."

Using AWS I was able to move a tables '.db' folder containing the Parquet and Manifest from the old bucket to the new bucket. Because this is S3 to S3, it was fast.

I was then able to mount the previously Managed Table, as an External Table by using the follow.

%sql
CREATE TABLE external_table USING DELTA OPTIONS (path '/Datalake/migrated_table');

This seems to be a very fast way to move data between the old and new Databrick platforms. However I am keen to know if anyone has also done this, and could share if there are implications I should be aware of?

1 REPLY 1

Anonymous
Not applicable

Hey there @John Brandborg​ 

Hope everything is going great!

Just wanted to check in if you were able to resolve your issue would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group