I have 2 Databricks Instance. Databricks A and Databricks B.
The Application Hightouch is consuming Data from Databricks B through Unity Catalog.
I have to create a Data pipeline to push data from Databricks A to B Without using Delta sharing.
Diagram:
Do I need to first store data in ADLS Gen2 of B than with Databricks add data to unity catalog. Is It Correct.
Or Do we have any better option.
Please share your thoughts.
Regards
You could use Lakehouse Federation. Attach 1 instance to another instance as a connection.
https://docs.databricks.com/aws/en/query-federation/databricks
