@fintech_latency 

For streaming: refactor to one long‑running Structured Streaming job with a short trigger interval (for example, 1s) and move “assignment” logic into foreachBatch or a transactional task table updated within the micro‑batch.

For per‑event RPC: deploy a custom Model Serving endpoint with:

• min_provisioned_concurrency > 0 (keeps N warm replicas),
• scale_to_zero disabled (no cold starts during quiet periods),
• optional Route Optimization if you scale to high QPS.