Hello,
Since a week ago, our notebook are stuck in running on the firsts cells which import python module from our github repository which is cloned in databricks.
The cells stays in running state and when we try to manually cancel the jobs in databricks, it remains in cancelling and never end until the cluster is terminated.
What is really weird, is that we have the issue only on specific branches, and if we recreate the branch there is no more issue...
When the notebooks are submitted from adf, i got the following error(when it fails, some notebooks run ok, others doesn't) :
OSError: [Errno 5] Input/output error: '/Workspace/Repos/datafactory-view-develop/***/src/curated/business'
The workspaces are clones from github repo, so I don't understand why i have issues when loading module from our workspaces, when same module is loaded in another notebook without issue...
I have close to no logs describing the issue in the cluster logs so it's really hard to identify the cause of this issue..
The cluster runs in Azure environment.
Does anyone already encountered this kind of issue ?
