cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks Cross cloud

Searce
New Contributor III

We have service with AWS Databricks. We are doing the same replica on GCP Databricks. Here we required all the services and functionalities should be run in AWS and AWS Databricks. The only thing data should be stored on the GCP Storage. Simply functions and services depend on the AWS side those related data should depend on GCP storage. Is this possible to do?

3 REPLIES 3

Ajay-Pandey
Esteemed Contributor III

I think it's not mandatory you can access the data from multiple cross-cloud in databricks.

Just you have to configure the same.

Ajay Kumar Pandey

Searce
New Contributor III

Thanks for the update, Yes I understand, we can access the data from cross-cloud.

Here we need a solution for only storing the data in GCP rest of the things in AWS. For example, pipelines and clusters need to be placed in AWS, data should be stored in GCP

Aviral-Bhardwaj
Esteemed Contributor III

no, right now i don't think they are supporting this type of architecture

AviralBhardwaj

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now