weinino
Databricks Partner

@karthik p​ Ok, thanks for the confirmation.

Data migration:

Disclaimer: The migration we are doing is rather a "POC" to get an understanding on the process and limitations for our clients.

  1. It is no real workspace and therefore the DBFS is very small. It should however resemble a case with several GB of data.
  2. Same as 1., but for simplicity I would say we need all the data.
  3. Same as 2., all data should be migrated
  4. Ok, I see. Could you confirm, that moving all files / folders under the old DBFS root to the new one with any suitable data transfer approach between cloud vendors should work without any addition?
  5. When I understood you correctly, this would mean,
    1. Pre-migration: Create an external table for each managed table an copy over the data
    2. Optional: Update all references in the old workspace to work with the external data if the old scripts still need to work
    3. On migration: Copy over the data to the new cloud vendors data storage
    4. Optional: Create managed table in new workspace for each migrated external table, copy the data and change back the references to use the internal tables