topic Re: "AWS S3 resource has been disabled" error on job, not appearing on notebook in Get Started Discussions

"AWS S3 resource has been disabled" error on job, not appearing on notebook

jvk — Sun, 28 Apr 2024 21:09:48 GMT

I am getting an "INTERNAL_ERROR" on a databricks job submitted through the API. Which says:

"Run result unavailable: run failed with error message All access to AWS S3 resource has been disabled"

However, when I click on the notebook created by the job and run this through the same cluster there are no errors and I am able to access the data.

Why would this be the case?Thanks

Re: "AWS S3 resource has been disabled" error on job, not appearing on notebook

jvk — Mon, 20 May 2024 04:51:47 GMT

Hi @Retired_mod , thanks for your help. I will look into these issues.

Re: "AWS S3 resource has been disabled" error on job, not appearing on notebook

jvk — Tue, 28 May 2024 07:30:10 GMT

Hi @Retired_mod , I have tried you suggestions but no luck.

It works fine when I am running via notebook, but when I put that same notebook into a job run and run that, I get the error:

"Run result unavailable: run failed with error message Cannot access AWS bucket"

Re: "AWS S3 resource has been disabled" error on job, not appearing on notebook

jvk — Wed, 29 May 2024 07:03:42 GMT

@Retired_mod

In the s3 logs of the run, I am seeing this:

24/05/29 06:39:30 WARN FileSystem: Failed to initialize fileystem dbfs:///: java.io.FileNotFoundException: Bucket user-workspace-s3-bucket does not exist
24/05/29 06:39:30 ERROR DbfsHadoop3: Failed to close FileSystem
java.lang.NullPointerException