Hi,
I have situation where I can run my notebook without any issue when I use a 'normal' cluster. However, when I run the exact same notebook in a job cluster it fails.
It fails at the point where it runs the cell:
`%run ../utils/some_other_notebook`
And the error seems to be caused by the following line which runs before the above one isn't doing what I am expecting:
`sys.path.append(os.path.abspath('../utils'))`
Now I run the job with the same user as when I run it with my 'normal' cluster. Also when I run the workflow with my 'normal' cluster attached it works. I also have the same construction working in other workspaces for job clusters.
So my question is what could be causing this behaviour in this specific workspace with the job cluster? What settings are there that I should check to see if there are any differences in the config?
