I created an external table and set the location on other AWS Account (External Location), lets call it Account B. Databricks workspace is deployed in other account. Lets call it Account A.
Here is my Script
CREATE TABLE devtest.governance.dbtable1(
col1 bigint
col2string
)
LOCATION s3://mys3bucket/governance
Im having an issue when i try to access the file usingf Account B, when i checked, the owner of the file is Account A and Account B is not on the ACL.
It seems like the spark config fs.s3a.acl.default BucketOwnerFullControl did not work.
How can i fix this? What should i change? and where should i change things.
All help appreciated.
