cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Trying to stream data from cosmosDb for mongoAPI (readstream/writeStream) into databricks getting error "java.lang.UnsupportedOperationException: Data source mongodb does not support microbatch processing"

parulpaul
New Contributor III
5 REPLIES 5

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi @Parul Paul​ , as of now, spark connector only support continuous processing not microbatch.

Please refer: https://jira.mongodb.org/browse/SPARK-368.

Kaniz
Community Manager
Community Manager

Hi @Parul Paul​, We haven’t heard from you since the last response from @Debayan Mukherjee​ , and I was checking back to see if you have a resolution yet.

If you have any solution, please share it with the community, as it can be helpful to others.

Otherwise, we will respond with more details and try to help.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

parulpaul
New Contributor III

No solution found

Kaniz
Community Manager
Community Manager

Hi @Parul Paul​, Did you check @Debayan Mukherjee​ 's response?

Kaniz
Community Manager
Community Manager

Hi @Parul Paul​, @Debayan Mukherjee​'s response is the final answer to your query. Please follow the Jira ticket for future updates regarding the micro-batch processing capability of the spark connector. I am marking his answer as the best for now. Thank you!

Please let us know if you have any further queries.