cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Databricks Cross cloud

Searce
New Contributor III

We have service with AWS Databricks. We are doing the same replica on GCP Databricks. Here we required all the services and functionalities should be run in AWS and AWS Databricks. The only thing data should be stored on the GCP Storage. Simply functions and services depend on the AWS side those related data should depend on GCP storage. Is this possible to do?

3 REPLIES 3

Ajay-Pandey
Esteemed Contributor III

I think it's not mandatory you can access the data from multiple cross-cloud in databricks.

Just you have to configure the same.

Ajay Kumar Pandey

Searce
New Contributor III

Thanks for the update, Yes I understand, we can access the data from cross-cloud.

Here we need a solution for only storing the data in GCP rest of the things in AWS. For example, pipelines and clusters need to be placed in AWS, data should be stored in GCP

Aviral-Bhardwaj
Esteemed Contributor III

no, right now i don't think they are supporting this type of architecture

AviralBhardwaj

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group