audioprocessingmovieminim

How can I access the audio output coming from a movie playing in processing?


I am working on a film analysis program, which retrieves data in realtime from a movie, that is playing in the same sketch. For analysing the sound I tried the minim library, but I can't figure out, how to get the audio signal from the movie. All I could do was accessing an audio file, I was loading into the sketch manually, or the line-in through the mic.

Thanks a lot!


Solution

  • Although GStreamer (used by the processing-video library) has access to audio, the processing-video library itself doesn't expose that at the moment.

    You will need to use workarounds at the moment:

    1. Extract audio from your movie and load straight into minim. (you can trigger audio playback at the same time as movie playback if you need to)
    2. or use a tool to use system audio output as an input (minim get line in). On OSX you can use Soundflower. Another option is JACK and it's patch interface.