Low Level Design for Moving Data from Databricks A to Databricks B

Pratikmsbsvm
Contributor

Hello Techie,

May someone please help me with Low level design point what all we should considered while moving data from One Delta lake instance to another delta lake.

For example :-

  1. Service principle creation.
  2. IP Whitelisting.
  3. Any gitlab / devops related support.

Diagram :

 

Pratikmsbsvm_1-1753184957933.png

I am trying to Build pipeline which bring data from A to B.

Please help.