Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
please help me to solve the problem that my data bricks account can not start the Job by triggering manually or scheduling although I can run the script without error.
Have you browsed through the docs for S3 secure acces (https://docs.databricks.com/administration-guide/cloud-configurations/aws/instance-profiles.html)?
Hi @trung nguyenโ , Please check if you have the necessary instance profile attached to the Job cluster. You are definitely missing something related to the IAM.
Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.
Join Us as a Local Community Builder!
Passionate about hosting events and connecting people? Help us grow a vibrant local communityโsign up today to get started!