- 2493 Views
- 1 replies
- 0 kudos
The cluster with the instance profile cannot access the S3 bucket. 403 permission denied is thrown
The document has been followed to configure the instance profile. The ec2 instance is able to access the S3 bucket when configured the same instance profile. However, the cluster configured to use the same instance profile failed to access the S3 buc...
- 2493 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
I suspect this is due to AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY has been added to the spark environmental variable. You can run %sh env | grep -i aws on your cluster and make sure AWS_ACCESS_KEY_ID is not present. If so, then please remove it e...
- 0 kudos