Trying to stream data from cosmosDb for mongoAPI (readstream/writeStream) into databricks getting error "java.lang.UnsupportedOperationException: Data source mongodb does not support microbatch processing"

[Debayan]

Hi @Parul Paul​ , as of now, spark connector only support continuous processing not microbatch.

Please refer: https://jira.mongodb.org/browse/SPARK-368.

[Kaniz_Fatma]

Hi @Parul Paul​, We haven’t heard from you since the last response from @Debayan Mukherjee​ , and I was checking back to see if you have a resolution yet.

If you have any solution, please share it with the community, as it can be helpful to others.

Otherwise, we will respond with more details and try to help.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

[parulpaul]

No solution found

[Kaniz_Fatma]

Hi @Parul Paul​, Did you check @Debayan Mukherjee​ 's response?

[Kaniz_Fatma]

Hi @Parul Paul​, @Debayan Mukherjee​'s response is the final answer to your query. Please follow the Jira ticket for future updates regarding the micro-batch processing capability of the spark connector. I am marking his answer as the best for now. Thank you!

Please let us know if you have any further queries.