Issue running notebook from another notebook in Job cluster

_paskal_1 — Thu, 21 Nov 2024 16:21:13 GMT

Hi,

I have situation where I can run my notebook without any issue when I use a 'normal' cluster. However, when I run the exact same notebook in a job cluster it fails.

It fails at the point where it runs the cell:
`%run ../utils/some_other_notebook`

And the error seems to be caused by the following line which runs before the above one isn't doing what I am expecting:

`sys.path.append(os.path.abspath('../utils'))`

Now I run the job with the same user as when I run it with my 'normal' cluster. Also when I run the workflow with my 'normal' cluster attached it works. I also have the same construction working in other workspaces for job clusters.
So my question is what could be causing this behaviour in this specific workspace with the job cluster? What settings are there that I should check to see if there are any differences in the config?

Re: Issue running notebook from another notebook in Job cluster

_paskal_ — Tue, 26 Nov 2024 18:42:37 GMT

Not sure what went wrong but after pulling the sources (notebooks) again from GIT it now works both for my 'normal' cluster and the 'job' cluster.
Case closed for me...

topic Issue running notebook from another notebook in Job cluster in Administration & Architecture

Issue running notebook from another notebook in Job cluster

Re: Issue running notebook from another notebook in Job cluster