Unable to Access S3 from Serverless but Works on Cluster

HarryRichard08
New Contributor II

Hi everyone,

I am trying to access data from S3 using an access key and secret. When I run the code through Databricks clusters, it works fine. However, when I try to do the same from a serverless cluster , I am unable to access the data.

I have already checked:

  • The credentials (access key and secret) are correct.
  • databricks scope

Could someone guide me on what additional configurations or steps I need to follow to make this work from a server?

Any help is greatly appreciated!

Thanks!