The fdsink element in GStreamer cannot be used to output the correct byte-stream to the pipeline
Because I need to output the RTSP stream pulled from the GStreamer command line to my Python program, I use the fdsink element to output the byte-stream from the pipeline.
The video can be displayed correctly by using the xvimagesink element. The command line is as follows.
gst-launch-1.0 rtspsrc location=rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mp4 ! queue2 ! rtph264depay ! capsfilter caps="video/x-h264, width=240, height=160" ! avdec_h264 ! videoconvert ! xvimagesink
Correct video:
Then I use fdsink instead of the xvimagesink element to output the byte stream from the pipeline and play it with ffplay. It can't display correct video. The command line is as follows.
gst-launch-1.0 rtspsrc location=rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mp4 ! queue2 ! rtph264depay ! capsfilter caps="video/x-h264, width=240, height=160" ! avdec_h264 ! videoconvert ! fdsink | ffplay -f rawvideo -pixel_format rgb24 -video_size 240*160 -i -
Wrong video:
So is fdsink element wrong or other elements wrong? Thank you for taking the time to help me solve the problem
There are two issues:
GStreamer writes text messages to
stdout, and FFplay interprets the text as raw pixels.
Add--quietto prevent GStreamer from writing text tostdout.Default GStreamer raw video format is "planar RGB" - red plain then green plane then blue plane.
We may convert pixel format to data ordered BGR (b,g,r,b,g,r...) by adding:
capsfilter caps="video/x-raw, format=BGR"
The following command plays well in my machine:
gst-launch-1.0 --quiet rtspsrc location=rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mp4 ! queue2 ! rtph264depay ! capsfilter caps="video/x-h264, width=240, height=160" ! avdec_h264 ! videoconvert ! capsfilter caps="video/x-raw, format=BGR" ! fdsink | ffplay -f rawvideo -pixel_format rgb24 -video_size 240x160 -i -
It also works without capsfilter caps="video/x-h264, width=240, height=160":
gst-launch-1.0 --quiet rtspsrc location=rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mp4 ! queue2 ! rtph264depay ! avdec_h264 ! videoconvert ! capsfilter caps="video/x-raw, format=BGR" ! fdsink | ffplay -f rawvideo -pixel_format rgb24 -video_size 240x160 -i -
- Simple batch script for merging video and audio with ffmpeg using two wildcards
- How to use FFmpeg with Java?
- Overlay video onto another video at multiple points in time
- How to stop ffmpeg remotely?
- FFmpeg MOV to MP4, do I also need .OGG , .WEBM files too?
- Create a bat file to exit FFMPEG (Windows)
- ffmpeg concat and preserve metadata streams
- hls.js unable to maintain seek with live video [only] stream
- Getting time codes in video files easier
- ffmpeg command to create thumbnail sprites
- How to run FFmpeg command in Java (Windows)
- avformat_write_header return error code when trying to write video with G711U audio avi file
- What does `-map data-re` option in FFMPEG do?
- Use Java FFmpeg wrapper, or simply use Java runtime to execute FFmpeg?
- ffmpeg piped output producing incorrect metadata frame count
- Restart environment and script during batch script
- How to combine The video and audio files in ffmpeg-python
- Using ffmpeg to create looping apng
- AVFrame with NV12 format breaks using D3D11 HW acceleration
- Is there another way to export a frame in ffmpeg to a texture2d? My code working in Windows but not Linux
- Kernel32 not found when using FFmpeg.Autogen 4.1.0.2 in Mono/Linux
- How to handle FFmpeg hardware decoder initialisation failure
- Which version of FFmpeg.AutoGen should I use?
- How To covert mp4 video to m3u8 in ffmpeg using nodejs
- FFmpeg problems: encode/normalize then concat multiples videos
- How to get the format of nvdec video frame from ffmpeg decoding ? How to use it in cuda structures?
- Trying to get pixels from a transparent AVI file to use them in a Raylib image but AVFrame comes out
- Cutting multimedia files based on start and end time using ffmpeg
- How to send RTP stream to Janus from NGINX RTMP module?
- Replace silence in audio using ffmpeg.wasm