cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Avi711
by New Contributor III
  • 3431 Views
  • 3 replies
  • 5 kudos

Resolved! Access denied error to S3 bucket while running Kinesis spark streaming.

I get this below error while trying to simulate kinesis streams as mentioned in Databricks documentation at https://docs.databricks.com/getting-started/streaming.htmlError:java.nio.file.AccessDeniedException:Amazon S3; Status Code: 403; Error Code: A...

  • 3431 Views
  • 3 replies
  • 5 kudos
Latest Reply
jsuarezg
New Contributor II
  • 5 kudos

If you do spark.sparkContext._jsc.hadoopConfiguration().set("fs.s3a.access.key", AWS_ACCESS_KEY_ID) + secret with any other secret that has less access than your default one this sometimes happens, so running those commands but with your normal secre...

  • 5 kudos
2 More Replies
THIAM_HUATTAN
by Valued Contributor
  • 857 Views
  • 3 replies
  • 1 kudos

medium.datadriveninvestor.com

say, I want to download 2 files from this directory (dbfs:/databricks-datasets/abc-quality/") to my local filesystem, how do I do it?I understand that if those files are inside FileStore directory, it is much straightforward, which someone posts some...

  • 857 Views
  • 3 replies
  • 1 kudos
Latest Reply
Pat
Honored Contributor III
  • 1 kudos

Hi @THIAM HUAT TAN​ ,isn't this dbfs://databricks-datasets Databricks owned s3:// mounted to the workspace? You got an error - 403 access denied to PUT files into the s3 bucket: https://databricks-datasets-oregon.s3.us-west-2.amazonaws.com you shoul...

  • 1 kudos
2 More Replies
Labels