Trying to stream data from cosmosDb for mongoAPI (readstream/writeStream) into databricks getting error "java.lang.UnsupportedOperationException: Data source mongodb does not support microbatch processing"
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-06-2022 03:17 AM
2 REPLIES 2
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-06-2022 11:18 PM
Hi @Parul Paul , as of now, spark connector only support continuous processing not microbatch.
Please refer: https://jira.mongodb.org/browse/SPARK-368.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-18-2022 12:54 AM
No solution found