topic access denied for S3 sources for course materials in Certifications

access denied for S3 sources for course materials

michalklucz — Fri, 21 Mar 2025 14:37:54 GMT

I've joined the Apache spark for Data Analysts course.

I am in the module 3: https://www.coursera.org/learn/apache-spark-sql-for-data-analysts/lecture/jNNcZ/using-course-materials

Whenever I am trying to create the structure on my cluster I receive a permission error from AWS side (can't read the source).

an important part of error:

Caused by: java.lang.Throwable: Forbidden; request: HEAD https://databricks-corp-training.s3.us-west-2.amazonaws.com common/dataframes/people-10m.parquet {} Hadoop 3.4.0, aws-sdk-java/1.12.728 Linux/5.15.0-1058-aws OpenJDK_64-Bit_Server_VM/17.0.10+7-Ubuntu-120.04.1 java/17.0.10 scala/2.12.18-bin-db-3-f50da8f kotlin/1.6.21 vendor/Private_Build cfg/retry-mode/legacy cfg/auth-source#unknown com.amazonaws.services.s3.model.GetObjectMetadataRequest; Request ID: W8X1R82BCX0XMZ7D, Extended Request ID: EXSyVCU7t44SDK+clLmWlzB2HtwrXYsi40eETuztKIUxoagtGS7EyXgWMDsoibQhbV9EBrVp2Dc=, Cloud Provider: AWS, Instance ID: i-0af2cf65983b32fb9 credentials-provider: com.amazonaws.auth.BasicAWSCredentials credential-header: AWS4-HMAC-SHA256 Credential=AKIAJBRYNXGHORDHZB4A/20240705/us-west-2/s3/aws4_request signature-present: true (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: W8X1R82BCX0XMZ7D; S3 Extended Request ID: EXSyVCU7t44SDK+clLmWlzB2HtwrXYsi40eETuztKIUxoagtGS7EyXgWMDsoibQhbV9EBrVp2Dc=; Proxy: null)

Coursera support already rejected my case as it's not a 'platform issue' but content.

cluster is ON, classroom has been set up

Re: access denied for S3 sources for course materials

michalklucz — Mon, 08 Jul 2024 11:03:18 GMT

Hello Fatima!

thank you for your reply. While it's technically correct, this is not applicable here, as we are discussing databricks owned buckets and materials.

here is a link to the course: https://www.coursera.org/learn/apache-spark-sql-for-data-analysts/supplement/P8ag4/course-materials

here is a link to dbc file: https://files.training.databricks.com/courses/moocs/SQLDA/Lessons.dbc

it should be modified on your side, not mine 😞

Re: access denied for S3 sources for course materials

michalklucz — Mon, 08 Jul 2024 11:31:14 GMT

Hello,thank you for your recommendation

as I can't log in to support (as I only have a community account) I created a ticket: #00499096 later after checking the topic, I also found that I after encountering the error, I instantly created a ticket: #00498644 .

till now, no reply from Friday.

I hope to see any contact soon as I can progress with the course.

Re: access denied for S3 sources for course materials

RishabhTiwari07 — Thu, 18 Jul 2024 15:59:49 GMT

Hi @michalklucz ,

I am following-up on this discussion. Is the issue stands resolved? Please let us know if you need further assistance.

Thanks

Rishabh

Re: access denied for S3 sources for course materials

supplierscave — Fri, 06 Sep 2024 18:45:52 GMT

Not yet. I am still having the same error.

Re: access denied for S3 sources for course materials

nir777 — Tue, 17 Sep 2024 15:15:05 GMT

Hi @michalklucz I am also facing the same issue. Did you got any solution on it??