topic Re: Unable to Read Collection/Files from MongoDB using Azure Databricks in Data Engineering

Unable to Read Collection/Files from MongoDB using Azure Databricks

simha08 — Sat, 01 Feb 2025 00:57:32 GMT

Hi there,

Can someone help to read data from MongoDB using Azure Databricks? Surprisingly, I am able to connect from Jupyter Notebook and read data, but not from the Azure Databricks.

1) I have install the required spark-connector packages in the cluster. 2) I have a valid MongoDB Atlas Cluster. 3) I have Spark cluster 13.3 LTS.

I am not even able to read the local database which I have created in Mongo DB Compass which has port 27017.

Can someone please help?

Re: Unable to Read Collection/Files from MongoDB using Azure Databricks

Alberto_Umana — Sat, 01 Feb 2025 16:04:02 GMT

Hi @simha08,

Can you test connectivity first to the MongoDB? using nc -vz hostname port.

Also please share the code you are using to establish the connection and read data.

Re: Unable to Read Collection/Files from MongoDB using Azure Databricks

simha08 — Mon, 03 Feb 2025 09:32:15 GMT

I am using following code to read the data from mongoDB using Databricks

from pyspark.sql import SparkSession
spark = SparkSession \
.builder \
.appName("myApp") \
.config("spark.mongodb.connection.uri", "mongodb+srv://username:password@cluster.xxxx.mongodb.net/database.collection") \
.getOrCreate()

df = spark.read.format("mongo").load()