I want to extract frames from a video and apply some filters on it such as gabor/hough etc. Which Java library would be perfect for handling all kinds of video encodings? I have been looking at GStreamer, JMF, Xuggler etc. but am unable to decide which one would be the best. I'm also looking to edit the frames and make the video with the new frames.
If you're looking to do low level operations such as extracting frames and manipulating them, then Xuggler would be the best choice, because the APIs are geared around this low level. It works on ffmpeg so can handle all types of video encodings.
Don't use JMF for anything, it's old, outdated and buggy - GStreamer is good, but the API lends itself more to playing videos rather than manipulating the frames.