I've joined the Apache spark for Data Analysts course.

I am in the module 3: https://www.coursera.org/learn/apache-spark-sql-for-data-analysts/lecture/jNNcZ/using-course-materia...

Whenever I am trying to create the structure on my cluster I receive a permission error from AWS side (can't read the source).

an important part of error:

Caused by: java.lang.Throwable: Forbidden; request: HEAD https://databricks-corp-training.s3.us-west-2.amazonaws.com common/dataframes/people-10m.parquet {} Hadoop 3.4.0, aws-sdk-java/1.12.728 Linux/5.15.0-1058-aws OpenJDK_64-Bit_Server_VM/17.0.10+7-Ubuntu-120.04.1 java/17.0.10 scala/2.12.18-bin-db-3-f50da8f kotlin/1.6.21 vendor/Private_Build cfg/retry-mode/legacy cfg/auth-source#unknown com.amazonaws.services.s3.model.GetObjectMetadataRequest; Request ID: W8X1R82BCX0XMZ7D, Extended Request ID: EXSyVCU7t44SDK+clLmWlzB2HtwrXYsi40eETuztKIUxoagtGS7EyXgWMDsoibQhbV9EBrVp2Dc=, Cloud Provider: AWS, Instance ID: i-0af2cf65983b32fb9 credentials-provider: com.amazonaws.auth.BasicAWSCredentials credential-header: AWS4-HMAC-SHA256 Credential=AKIAJBRYNXGHORDHZB4A/20240705/us-west-2/s3/aws4_request signature-present: true (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: W8X1R82BCX0XMZ7D; S3 Extended Request ID: EXSyVCU7t44SDK+clLmWlzB2HtwrXYsi40eETuztKIUxoagtGS7EyXgWMDsoibQhbV9EBrVp2Dc=; Proxy: null)

Coursera support already rejected my case as it's not a 'platform issue' but content.

cluster is ON, classroom has been set up