cancel
Showing results for 
Search instead for 
Did you mean: 

Import module never ends on random branches

Valentin14
New Contributor II

Hello,

Since a week ago, our notebook are stuck in running on the firsts cells which import python module from our github repository which is cloned in databricks.

The cells stays in running state and when we try to manually cancel the jobs in databricks, it remains in cancelling and never end until the cluster is terminated.

What is really weird, is that we have the issue only on specific branches, and if we recreate the branch there is no more issue...

When the notebooks are submitted from adf, i got the following error(when it fails, some notebooks run ok, others doesn't) :

OSError: [Errno 5] Input/output error: '/Workspace/Repos/datafactory-view-develop/***/src/curated/business'

The workspaces are clones from github repo, so I don't understand why i have issues when loading module from our workspaces, when same module is loaded in another notebook without issue...

I have close to no logs describing the issue in the cluster logs so it's really hard to identify the cause of this issue..

The cluster runs in Azure environment.

Does anyone already encountered this kind of issue ?

1 ACCEPTED SOLUTION

Accepted Solutions

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi @Valentin Rosca​, Without the logs it will be very hard to determine the cause of the issue. As the first step could you please raise a support case to Azure so that they can do the primary investigation on this and reach out to us if anything is needed.

Please tag @Debayan​ with your next comment so that I will get notified. Thank you!

View solution in original post

2 REPLIES 2

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi @Valentin Rosca​, Without the logs it will be very hard to determine the cause of the issue. As the first step could you please raise a support case to Azure so that they can do the primary investigation on this and reach out to us if anything is needed.

Please tag @Debayan​ with your next comment so that I will get notified. Thank you!

Anonymous
Not applicable

Hi @Valentin LEBOSSE​ 

Thank you for posting your question in our community! We are happy to assist you.

To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?

This will also help other community members who may have similar questions in the future. Thank you for your participation and let us know if you need any further assistance! 

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.