08-01-2022 12:18 AM
please help me to solve the problem that my data bricks account can not start the Job by triggering manually or scheduling although I can run the script without error.
08-01-2022 02:30 AM
A permission issue for sure.
Have you browsed through the docs for S3 secure acces (https://docs.databricks.com/administration-guide/cloud-configurations/aws/instance-profiles.html)?
08-01-2022 03:25 AM
when I put the script outside and run it manually there is no error, but when I put in a Job It pops up above the error.
08-01-2022 03:41 PM
Hi @trung nguyen , Please check if you have the necessary instance profile attached to the Job cluster. You are definitely missing something related to the IAM.
08-05-2022 02:35 AM
Thank Vivian Wilfred, we had attached the instance profile before.
08-30-2022 10:05 AM
Hi,
Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.
Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!
Sign Up Now