Custom library import fails randomly with error: not found: value it

nk76
New Contributor III

Hello,

I have an issue with the import of a custom library, in Azure Databricks.

(roughly) 95% of the times it works fine, but sometimes it fails.

I searched the internet and this community with no luck, so far.

It is a scala library in a scala notebook, and its import command is just like:

import it.foo.bar.MyClass

It works fine, usually; sometimes, with no reason (that I can think of) it fails like this:

command-261888690252589:1: error: not found: value it

If I rerun the very same activity, it works fine.

Do you have any idea why this happens, or how I could investigate it further?

Several such import commands might run at the same time (in parallel, in Azure Data Factory), I don't know if this might cause some trouble.

I could set some retry mechanism, but I would like to understand what exactly is going on here.

Thank you,

Nk