Hi @lauraxyz ,
When you ran the code using the notebook, it would run it by default. Could you check if the principal in the run_as parameter in the job has permission on the files?
Ref to change run_as parameter - "https://kb.databricks.com/jobs/trigger-a-job-as-a-specific-user-with-run-as"
