Highly Performant Data Ingestion and Processing Pipelines

hagarciaj
New Contributor

Hi everyone,

I am working on a project that requires highly performant pipelines for managing data ingestion, validation, and processing large data volumes from IOT devices.

I am interested in knowing:
- The best way to ingest from EventHub/Kafka sinks
- Data validation
- Post-processing after data ingestion
- Reprocessing incorrect data

If you have experience in this area and would be willing to chat with me, I would greatly appreciate it. I would like to know how you handle specific challenges and learn about your experience and best practices.

Please feel free to contact me to schedule a time to talk. I look forward to hearing from you.

Best regards,

Hector A Garcia