How to Create Cluster that should have access to AWS Glue Catalog in different account

[prakash_raj]

How to Create Cluster that should have access to AWS Glue Catalog in different account

[Prabakar · Accepted solution]

Hi @Prakash Rajendran​ , If the Glue Data Catalog is in a different AWS account from where Databricks is deployed, a cross-account access policy must allow access to the catalog from the AWS account where Databricks is deployed.

Please refer to the below doc.

https://docs.databricks.com/data/metastores/aws-glue-metastore.html#requirements

[prakash_raj]

Thank you.

I have a java spark jar, that does the same. Still that jar can I run in Databricks? instead of pyspark?

[Shriram_w]

So I need to allow the role which I am using in my instance profile of cluster in data catalog setting

[Shriram_w]

I mean to say I need to allow the role  which I am using in my databricks cluster in my account where I want access the glue catalog