cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Access denied error to S3 bucket while running Kinesis spark streaming.

Avi711
New Contributor III

I get this below error while trying to simulate kinesis streams as mentioned in Databricks 

documentation at https://docs.databricks.com/getting-started/streaming.html

Error:

java.nio.file.AccessDeniedException:

Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID:

com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied; request: PUT https://..

Does anyone faced this issue. Any pointers will be very helpful.

1 ACCEPTED SOLUTION

Accepted Solutions

Avi711
New Contributor III

It was an access issue to S3 bucket, resolved by providing appropriate access. Thanks

View solution in original post

3 REPLIES 3

Pat
Honored Contributor III

Hi @Aviraj Madkaikar​ ,

Access Denied; request: PUT... . It looks like you don't have permission to write to the location.

Do you use .checkpoint or write data somewhere?

Avi711
New Contributor III

It was an access issue to S3 bucket, resolved by providing appropriate access. Thanks

jsuarezg
New Contributor II

If you do 

spark.sparkContext._jsc.hadoopConfiguration().set("fs.s3a.access.key", AWS_ACCESS_KEY_ID) + secret with any other secret that has less access than your default one this sometimes happens, so running those commands but with your normal secret will fix the issue
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!