Data Transfer Between 2 Databricks Instance without using Delta share.

[Pratikmsbsvm]

Hello,

I am not allow to use Delta share.

What could be best approach to send Data from Databricks A to Databricks B. AS Shown in diagram.

what mechanism we can used to transfer the data. for example:- Do I need to open port or any other mechanism like RestAPI..... etc. 

Shall I first transformed the data than send to B or shall I send the Raw Data from A to B and perform the transformation at B. 

Which approach is more reliable in Production and why ?.

Thanks a lot for your help.

[BigRoux]

If the two workspaces are in the same region (same control plane), then there is no need to transfer data.  Remember, Databricks does not store your data or put it into a proprietary format.  You give Databricks the permissions to access the data that resides in your cloud account.  It is just a matter of granting privileges via Unity Catalog.