Union Data from two separate Databricks Workspaces
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-07-2022 06:51 AM
Hi Everyone,
This may sound bit odd as I haven't used Databricks much.
I have a use case where I want to union data from two separate Databricks workspaces (under the same account) into a single SQL view. (Basically 2-2 tables from each workspaces and Data is not that big)
Which is the best way to do so? I believe unity catalog or Delta sharing are the options but I'm not sure which one is the best to proceed with?
Also, are there any additional details that I need to take care of while doing so?
p.s. - I'm researching the options for now, I haven't tested anything yet on the data.
Any leads are appreciated. Thanks in advance.
Thanks,
Bindi
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-10-2022 03:07 AM
@Kaniz Fatma
Thanks for providing your inputs.
I have to use and maintain this for this single use case. we haven't set up feature store workspace at the moment.
Do you think, It's a good idea to create and maintain feature store for it?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-20-2022 04:55 AM
As suggested by Databricks support team, we are looking at the option of Unity Catalog to implement for our business case.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-12-2022 09:36 AM
Hey there @Bindi P
Hope all is well!
Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? It would be really helpful for the other members too.
Cheers!
