topic Re: Unable to connect to mongodb spark connector on a shared cluster in Data Engineering

Unable to connect to mongodb spark connector on a shared cluster

lmorrissey — Thu, 06 Feb 2025 00:01:52 GMT

The connector works without issue if the cluster is made private; does anyone know why this is or have a workaround (besides spawning a bunch of private clusters)

Re: Unable to connect to mongodb spark connector on a shared cluster

Alberto_Umana — Thu, 06 Feb 2025 01:13:56 GMT

Hi @lmorrissey,

What do you mean by cluster is made private? are you using any Private Link network setup?

Re: Unable to connect to mongodb spark connector on a shared cluster

lmorrissey — Thu, 06 Feb 2025 02:02:56 GMT

The cluster configuration access mode (under cluster configuration) needs to be single user access to use the mongo db spark connector. Tagging @Elebioda for detail.

Re: Unable to connect to mongodb spark connector on a shared cluster

dewman — Sun, 16 Mar 2025 23:58:35 GMT

Any news on this? I too am having issues where a dedicated cluster can read from MongoDB no problem but as soon as I try to run the notebook with a shared cluster, I get an ConflictType (ofclass com.mongodb.spark.sql.types.ConflictTypes) error