- 3842 Views
- 6 replies
- 1 kudos
FFmpeg frame extraction explodes memory, how to mitigate?
For a computer vision project, my raw data consists of encrypted videos (60fps) stored in Azure Blob Storage. In order to have the data usable for model training, I need to do some preprocessing and for that I need the video split into individual fra...
- 3842 Views
- 6 replies
- 1 kudos
- 1 kudos
In the end, I decided to change around the workflow so it is as efficient as I could imagine it:Extract frames of video files in a containerized application somewhere running ffmpeg and storing the resulting frames in a parquet file in blob storage (...
- 1 kudos
- 1459 Views
- 1 replies
- 0 kudos
how does the data science workflow change in databricks if you start with a nosql database (specifically document store) instead of something more traditional/rdbms type source?
I'm sorry if this is a bad question. The tl;dr is are there any concrete examples of a nosql data science workflows specifically in databricks and if so what are they?is it always the case that our end goal is a dataframe?For us we start as a bunch o...
- 1459 Views
- 1 replies
- 0 kudos
- 0 kudos
Nice sharing, thanks!
- 0 kudos