Hi,

I'm trying to create an external location that accesses a public s3 bucket (for open data). However, I'm not having any success. I'm confused to what to specify as the storage credential (IAM role) since its a public bucket that is out of my control. By the way, I can easily select the data directly using pyspark e.g. by calling spark.read.json, but thought it made sense to use an external location first. Any ideas on the steps to take? Or is using an external location a waste of time in this case?

Thanks!