Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-26-2022 08:57 AM
I am reading data from a Kafka topic, say topic_a.
I have an application, app_one which uses Spark Streaming to read data from topic_a. I have a checkpoint location, loc_a to store the checkpoint.
Now, app_one has read data till offset 90.
Can I create a new notebook, say app_two and then copy the checkpoint folder and point the app_two to this copied checkpoint folder. Will this start reading from offset 90?
Labels:
- Labels:
-
Kafka consumer
-
Structured streaming