06-23-2021 02:52 PM
How to update a streaming job in production with minimal/no downtime when there are significant code changes that may not be compatible with the existing checkpoint state to resume the stream processing?
09-16-2021 03:38 AM
06-23-2021 04:10 PM
This will likely be use case/situation dependent. Can you provide an example of your current streaming setup and what kind of changes you anticipate that you'd like to perform with minimal downtime?
09-16-2021 03:38 AM
11-10-2021 07:26 AM
Can you provide the source and sink type?
07-21-2022 03:33 AM
I have the same scenario, I am using source type as parquet and sink type as delta in Azure Data Lake Gen2. I need to change the checkpoint location, how can we exclude existing files ?. Without using autoloader feature can we do that, please confirm .
Please help asap
Thanks
07-25-2022 01:51 AM
Thanks for the information, I will try to figure it out for more. Keep sharing such informative post keep suggesting such post.
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.