Spark connector to mongodb - mongo-spark-connector_2.12:10.1.1
Anonymous
Not applicable
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-11-2023 02:49 PM
Hello,
I´ve added a library to the cluster and it appears in SPARK UI as Added By User
spark://10.139.64.4:43001/jars/addedFile307892533757162075org_mongodb_spark_mongo_spark_connector_2_12_10_1_1-98946.jarAdded By User
I'm trying to connect using the following SparkSession configuration, but it is not working:
spark = (SparkSession.builder.config('spark.mongodb.input.uri',connectionString).config('spark.jars.packages', 'org.mongodb.spark:mongo-spark-connector_2.12:10.1.1').getOrCreate())
If I uninstall this library and install the previous one the , 2.12:3.0.1, the conection works.
Does anyone can help me with that?
Thanks
Labels:
- Labels:
-
Spark connector
-
Spark ui