Hello,
I´ve added a library to the cluster and it appears in SPARK UI as Added By User
spark://10.139.64.4:43001/jars/addedFile307892533757162075org_mongodb_spark_mongo_spark_connector_2_12_10_1_1-98946.jarAdded By User
I'm trying to connect using the following SparkSession configuration, but it is not working:
spark = (SparkSession.builder.config('spark.mongodb.input.uri',connectionString).config('spark.jars.packages', 'org.mongodb.spark:mongo-spark-connector_2.12:10.1.1').getOrCreate())
If I uninstall this library and install the previous one the , 2.12:3.0.1, the conection works.
Does anyone can help me with that?
Thanks