topic Re: How to migrate data from an existing workspace to a new workspace? in Data Engineering

How to migrate data from an existing workspace to a new workspace?

tz1 — Tue, 01 Mar 2022 15:22:41 GMT

Re: How to migrate data from an existing workspace to a new workspace?

Hubert-Dudek — Tue, 01 Mar 2022 19:30:31 GMT

If you are referring to workspace as workspace folder there is API for that https://docs.databricks.com/dev-tools/api/latest/workspace.html#export

If you are referring to whole Databricks installation (like Azure workspace). Is more complicated as you need to export infra template, hive metastore etc. (if you have purchased support on Azure/Aws, they can help)

Re: How to migrate data from an existing workspace to a new workspace?

tz1 — Wed, 02 Mar 2022 16:58:16 GMT

Thanks, Hubert.
I am referring to the Delta Tables and the corresponding Hive Tables in Databricks.
Probably closer to the whole Databricks installation you mentioned.

Re: How to migrate data from an existing workspace to a new workspace?

Anonymous — Mon, 07 Mar 2022 00:42:33 GMT

@Tony Zhou - I am the least technical person on the planet. Did Hubert's answer help resolve the problem, or would you like more help?

Re: How to migrate data from an existing workspace to a new workspace?

tz1 — Wed, 09 Mar 2022 19:26:13 GMT

And I got this problem when using the Workspace API 2.0

<html>

<head>

<title>Error 401 Unauthorized</title>

</head>

<body><h2>HTTP ERROR 401</h2>

<p>Problem accessing /api/2.0/workspace/export. Reason:

<pre> Unauthorized</pre></p>

</body>

</html>

Re: How to migrate data from an existing workspace to a new workspace?

Hubert-Dudek — Thu, 10 Mar 2022 13:48:23 GMT

Probably access token expired. Please run configure again.

Re: How to migrate data from an existing workspace to a new workspace?

User16753725182 — Fri, 11 Mar 2022 08:26:57 GMT

Hi @Tony Zhou , Were you able to run this after generating a new token?