Hey @Yuki ,

If you’re using instance profiles to access S3, make sure your cluster is running in “Single User”(or Dedicated) access mode. Instance profiles won’t work with Shared(or Standard) or No Isolation clusters, especially if you’re trying to access S3 from Unity Catalog or within notebooks.

You can check this by going to your cluster settings and verifying that it’s configured Access Mode: Single User/Dedicated, and that the correct user is assigned (the one mapped to the instance profile, either directly or via group policies).

If this doesn't solve your problem, please post the cluster configuration instance profile json and error 🙂

Hope this helps 🙂

Isi