Highly Performant Data Ingestion and Processing Pipelines
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-27-2023 11:18 AM
Hi everyone,
I am working on a project that requires highly performant pipelines for managing data ingestion, validation, and processing large data volumes from IOT devices.
I am interested in knowing:
- The best way to ingest from EventHub/Kafka sinks
- Data validation
- Post-processing after data ingestion
- Reprocessing incorrect data
If you have experience in this area and would be willing to chat with me, I would greatly appreciate it. I would like to know how you handle specific challenges and learn about your experience and best practices.
Please feel free to contact me to schedule a time to talk. I look forward to hearing from you.
Best regards,
Hector A Garcia