External table from external location

[210227]

Hi, 

I'm creating external table from existing external location and am a bit puzzled as to what permissions I need for it or what is the correct way of defining the S3 path with wildcards. 

This:

create external table if not exists test_catalogue_dev.bronze.test_external

using csv

location 's3://test-data/full/2023/01/*/'

OPTIONS(

recursiveFileLookup "true",

ignoreExtension "true",

infereSchema "true"

)
returns java.nio.file.AccessDeniedException, yet:

create external table if not exists test_catalogue_dev.bronze.test_external

using csv

location 's3://test-data/full/2023/01/01/'

OPTIONS(

recursiveFileLookup "true",

ignoreExtension "true",

infereSchema "true"

)

happily creates one. 

Is  using a wildcard trying to put something in the external bucket? 

[210227 · Accepted solution]

Just for the reference, the wildcard is not needed in this case, just a misleading error message. In this case 's3://test-data/full/2023/01/' instead of 's3://test-data/full/2023/01/*/' was the correct PATH