Utilize Uberโs Petastorm https://github.com/uber/petastorm to read in and generate a parquet dataset from the image data. The petastorm APIโs can then be used to generate a TF Dataset, etc.
Welcome to Databricks Community: Lets learn, network and celebrate together
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.