Issue loading spark Scala library

Anonymous
Not applicable

We have a proprietary spark scala library, which is necessary for me to do my work. We build a release version once a week and store it in a specific s3 location (so the most up-to-date prod version is always stored in the same place). But so far I can’t figure out a reasonable way to load the library that’s not a huge pain. In an ideal world, my clusters would automatically install the jar from the prod folder on s3 when they start up. Tons of people at the company rely on this library. Do you know if there’s a way to achieve this? Thanks!