Hi! I'm trying DataBricks free trial and I tried to link it to an S3 Bucket I set up but I get errors related to serverless policies and unauthorized access whether I tried to read or write to S3, but I have no problem just listing the files that exist in S3.
Error creating table
Network error - Full error message: Your request failed with status FAILED: [BAD_REQUEST] [UNAUTHORIZED_ACCESS] Unauthorized access: s3://databrickslake123/__unitystorage/schemas/4be78c72-8538-426d-8a7b-6e2770a593b3/tables/72cd995c-0a03-4e2b-b50a-e30354d149cd/_delta_log: getFileStatus on s3://databrickslake123/__unitystorage/schemas/4be78c72-8538-426d-8a7b-6e2770a593b3/tables/72cd995c-0a03-4e2b-b50a-e30354d149cd/_delta_log: com.amazonaws.services.s3.model.AmazonS3Exception: Access to storage destination is denied because of serverless network policy; request: HEAD http://databrickslake123.s3.us-east-2.amazonaws.com __unitystorage/schemas/4be78c72-8538-426d-8a7b-6e2770a593b3/tables/72cd995c-0a03-4e2b-b50a-e30354d149cd/_delta_log {} Hadoop 3.3.6, aws-sdk-java/1.12.638 Linux/5.15.0-1072-aws OpenJDK_64-Bit_Server_VM/17.0.13+11-LTS java/17.0.13 scala/2.12.15 kotlin/1.9.10 vendor/Azul_Systems,_Inc. cfg/retry-mode/legacy com.amazonaws.services.s3.model.GetObjectMetadataRequest; Request ID: null, Extended Request ID: null, Cloud Provider: AWS, Instance ID: unknown credentials-provider: com.amazonaws.auth.BasicSessionCredentials credential-header: AWS4-HMAC-SHA256 Credential=ASIAWZ5SLZBPSUFMJKOW/20250426/us-east-2/s3/aws4_request signature-present: true (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: null; S3 Extended Request ID: null; Proxy: 127.0.0.1), S3 Extended Request ID: null:403 Forbidden SQLSTATE: 42501
What could be causing this and is this possible to set up in a free trial?