If you're looking for a library to do this programmatically, try imageio (Python) or OpenCV's VideoCapture (C/C++/Python/Java). I recommend imageio - very easy to deploy, compared to OpenCV. Don't know about other languages.
Here is one way to just extract the frames:
ffmpeg -i in.avi -q:v 0 imagename_%04d.jpg
ImageMagick http://www.imagemagick.org/script/index.php
Google h264 to raw. Yuv format is what you describe
If you're looking for a library to do this programmatically, try imageio (Python) or OpenCV's VideoCapture (C/C++/Python/Java). I recommend imageio - very easy to deploy, compared to OpenCV. Don't know about other languages.