Data Transfer Between 2 Databricks Instance without using Delta share.

Pratikmsbsvm
Contributor

Hello,

I am not allow to use Delta share.

What could be best approach to send Data from Databricks A to Databricks B. AS Shown in diagram.

Pratikmsbsvm_0-1754553518217.png

what mechanism we can used to transfer the data. for example:- Do I need to open port or any other mechanism like RestAPI..... etc. 

Shall I first transformed the data than send to B or shall I send the Raw Data from A to B and perform the transformation at B. 

Which approach is more reliable in Production and why ?.

Thanks a lot for your help.