topic Re: Job fail due to Access Denied in Data Engineering

Job fail due to Access Denied

Trung — Mon, 01 Aug 2022 07:18:20 GMT

please help me to solve the problem that my data bricks account can not start the Job by triggering manually or scheduling although I can run the script without error.

Re: Job fail due to Access Denied

-werners- — Mon, 01 Aug 2022 09:30:15 GMT

A permission issue for sure.

Have you browsed through the docs for S3 secure acces (https://docs.databricks.com/administration-guide/cloud-configurations/aws/instance-profiles.html)?

Re: Job fail due to Access Denied

Trung — Mon, 01 Aug 2022 10:25:11 GMT

when I put the script outside and run it manually there is no error, but when I put in a Job It pops up above the error.

Re: Job fail due to Access Denied

Vivian_Wilfred — Mon, 01 Aug 2022 22:41:05 GMT

Hi @trung nguyen , Please check if you have the necessary instance profile attached to the Job cluster. You are definitely missing something related to the IAM.

Re: Job fail due to Access Denied

Trung — Fri, 05 Aug 2022 09:35:08 GMT

Thank Vivian Wilfred, we had attached the instance profile before.

Re: Job fail due to Access Denied

jose_gonzalez — Tue, 30 Aug 2022 17:05:57 GMT

Hi,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.