06-07-2021 11:13 AM
How do I efficiently read image data for a deep learning model?
Utilize Uber’s Petastorm https://github.com/uber/petastorm to read in and generate a parquet dataset from the image data. The petastorm API’s can then be used to generate a TF Dataset, etc.
06-08-2021 12:46 PM
Our documentation provides nice examples of preparing image data for training and inference.
Training: See docs for AWS, Azure, GCP
Inference: See reference solution for AWS, Azure, GCP
