Concurrent State Update from Worker Nodes Possible?
For a data processing pipeline I use structured streaming and arbitrary stateful processing. I was wondering if the partitioning over several worker nodes and thus updating the state from different worker nodes has to be considered (e.g. using a lock...
- 1114 Views
- 0 replies
- 0 kudos