How to Create Cluster that should have access to AWS Glue Catalog in different account

prakash_raj
New Contributor II

How to Create Cluster that should have access to AWS Glue Catalog in different account

Prabakar
Databricks Employee
Databricks Employee

Hi @Prakash Rajendran​ , If the Glue Data Catalog is in a different AWS account from where Databricks is deployed, a cross-account access policy must allow access to the catalog from the AWS account where Databricks is deployed.

Please refer to the below doc.

https://docs.databricks.com/data/metastores/aws-glue-metastore.html#requirements

View solution in original post

Thank you.

I have a java spark jar, that does the same. Still that jar can I run in Databricks? instead of pyspark?

Shriram_w
New Contributor II

So I need to allow the role which I am using in my instance profile of cluster in data catalog setting

Shriram_w
New Contributor II

I mean to say I need to allow the role  which I am using in my databricks cluster in my account where I want access the glue catalog