Vivian_Wilfred
Databricks Employee
Databricks Employee

Hi @Wasim Reza​ 

Why is fs.s3a.endpoint pointing to http://my-ip:9000? Can you verify if this is the right aws endpoint?

Is there any instance profile attached to the cluster? access-secret keys along with instance profile can be confusing.

Verify the permissions on the AWS side.