lbourgeois
New Contributor III

Thanks @Hubert Dudek​ for having a look.

I don't use unity catalog, I actually use 3.Encode keys in URI option for S3 Auth as described in https://docs.databricks.com/external-data/amazon-s3-select.html#s3-authentication

Strange thing is that if I change format to csv in DataFrameReader I don't face this issue (even without specifying any region or endpoint). What I wonder is :

  • is there any limitation around region when using s3 select connector ?
  • if know how to specify a different region to avoid this exception ?