Data Transfer Between 2 Databricks Instance without using Delta share.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-07-2025 01:01 AM - edited 08-07-2025 01:25 AM
Hello,
I am not allow to use Delta share.
What could be best approach to send Data from Databricks A to Databricks B. AS Shown in diagram.
what mechanism we can used to transfer the data. for example:- Do I need to open port or any other mechanism like RestAPI..... etc.
Shall I first transformed the data than send to B or shall I send the Raw Data from A to B and perform the transformation at B.
Which approach is more reliable in Production and why ?.
Thanks a lot for your help.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-07-2025 11:04 AM
If the two workspaces are in the same region (same control plane), then there is no need to transfer data. Remember, Databricks does not store your data or put it into a proprietary format. You give Databricks the permissions to access the data that resides in your cloud account. It is just a matter of granting privileges via Unity Catalog.