Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
please help me to solve the problem that my data bricks account can not start the Job by triggering manually or scheduling although I can run the script without error.
Have you browsed through the docs for S3 secure acces (https://docs.databricks.com/administration-guide/cloud-configurations/aws/instance-profiles.html)?
Hi @trung nguyen , Please check if you have the necessary instance profile attached to the Job cluster. You are definitely missing something related to the IAM.
Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.
Connect with Databricks Users in Your Area
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
