topic Re: Union Data from two separate Databricks Workspaces in Data Governance

Union Data from two separate Databricks Workspaces

626371 — Tue, 07 Jun 2022 13:51:55 GMT

Hi Everyone,

This may sound bit odd as I haven't used Databricks much.

I have a use case where I want to union data from two separate Databricks workspaces (under the same account) into a single SQL view. (Basically 2-2 tables from each workspaces and Data is not that big)

Which is the best way to do so? I believe unity catalog or Delta sharing are the options but I'm not sure which one is the best to proceed with?

Also, are there any additional details that I need to take care of while doing so?

p.s. - I'm researching the options for now, I haven't tested anything yet on the data.

Any leads are appreciated. Thanks in advance.

Thanks,

Bindi

Re: Union Data from two separate Databricks Workspaces

626371 — Fri, 10 Jun 2022 10:07:58 GMT

@Kaniz Fatma

Thanks for providing your inputs.

I have to use and maintain this for this single use case. we haven't set up feature store workspace at the moment.

Do you think, It's a good idea to create and maintain feature store for it?

Re: Union Data from two separate Databricks Workspaces

626371 — Mon, 20 Jun 2022 11:55:04 GMT

As suggested by Databricks support team, we are looking at the option of Unity Catalog to implement for our business case.

Re: Union Data from two separate Databricks Workspaces

Anonymous — Fri, 12 Aug 2022 16:36:35 GMT

Hey there @Bindi P

Hope all is well!

Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? It would be really helpful for the other members too.

Cheers!