- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-01-2022 02:09 AM
Hello,
I have an issue with the import of a custom library, in Azure Databricks.
(roughly) 95% of the times it works fine, but sometimes it fails.
I searched the internet and this community with no luck, so far.
It is a scala library in a scala notebook, and its import command is just like:
import it.foo.bar.MyClassIt works fine, usually; sometimes, with no reason (that I can think of) it fails like this:
command-261888690252589:1: error: not found: value itIf I rerun the very same activity, it works fine.
Do you have any idea why this happens, or how I could investigate it further?
Several such import commands might run at the same time (in parallel, in Azure Data Factory), I don't know if this might cause some trouble.
I could set some retry mechanism, but I would like to understand what exactly is going on here.
Thank you,
Nk
- Labels:
-
Azure
-
Azure databricks
-
Scala notebook