Why do we need different AWS Accounts ?

HappySK — Sat, 23 Sep 2023 03:10:30 GMT

I am just going through the AWS Databricks Platform Administration course and I am curious to know about the Cloud Accounts used to setup Databricks

When we are setting up the Databricks, we are using AWS Account but we are not using that account saying we will be using the another account to manage all the data and processing

Could someone please help what Databricks do with the AWS Account from where it is created ?

Re: Why do we need different AWS Accounts ?

dleblanc — Thu, 05 Oct 2023 20:01:36 GMT

Hi @HappySK,

The AWS account you're using basically serves as the data plane - this is where your data lives, and the compute resources that process it (at least in the classical compute model) will be provisioned there as well. As part of the configuration to make Databricks work, you'll be granting Databricks limited access to your account using a cross account IAM role. This is the piece that enables Databricks (the control plane) to set up the resources needed to support workspaces and associated compute resources. Similarly, any data containers will require a role for Databricks/Unity Catalog to access. Hopefully this answers your question.

By the way, I just wanted to clarify if you are going through "AWS Databricks Platform Administration" or "AWS Databricks Platform Architect"? They are two different courses, with the Architect one being newer.

topic Re: Why do we need different AWS Accounts ? in Administration & Architecture

Why do we need different AWS Accounts ?

Re: Why do we need different AWS Accounts ?