Hi everyone,
I am working on a project that requires highly performant pipelines for managing data ingestion, validation, and processing large data volumes from IOT devices.
I am interested in knowing:
- The best way to ingest from EventHub/Kafka sinks
- Data validation
- Post-processing after data ingestion
- Reprocessing incorrect data
If you have experience in this area and would be willing to chat with me, I would greatly appreciate it. I would like to know how you handle specific challenges and learn about your experience and best practices.
Please feel free to contact me to schedule a time to talk. I look forward to hearing from you.
Best regards,
Hector A Garcia