Opened 9 years ago
Closed 9 years ago
#6566 closed defect (fixed)
Overlay drops frames when audio is also processed
| Reported by: | Gyan | Owned by: | |
|---|---|---|---|
| Priority: | important | Component: | undetermined |
| Version: | git-master | Keywords: | |
| Cc: | Blocked By: | ||
| Blocking: | Reproduced by developer: | no | |
| Analyzed by developer: | no |
Description
When performing an overlay of one video over the other, ffmpeg reports Buffer queue overflow and the overlay freezes at multiple points. Adding fifo filters to the two video feeds doesn't help. However, omitting the audio, resolves the issue.
# 1 Generate source files
ffmpeg -f lavfi -i testsrc2=d=55 -f lavfi -i testsrc=d=10 \
-f lavfi -i sine=d=55 -f lavfi -i sine=640:d=10 \
-map 0 -map 2 in.mp4 \
-map 1 -map 3 ol.mp4
(The behaviour doesn't occur with direct lavfi source feeds)
# 2 Overlay with audio - overlay video freezes
ffmpeg -i in.mp4 -i ol.mp4 -strict -2 -filter_complex \ "[0:v]setpts=PTS-STARTPTS[v0];[1:v]setpts=PTS-STARTPTS+5/TB[v1]; \ [v0][v1]overlay=(main_w-overlay_w)/2:(main_h-overlay_h)/2:eof_action=pass[outv]; \ [1:a]adelay=5000[a1];[0:a][a1]amix[outa]" \ -map [outv] -map [outa] out.mp4
ffmpeg version N-86920-g1193301 Copyright (c) 2000-2017 the FFmpeg developers
built with gcc 7.1.0 (GCC)
configuration: --enable-gpl --enable-version3 --enable-cuda --enable-cuvid --enable-d3d11va --enable-dxva2 --enable-libmfx --enable-nvenc --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-zlib
libavutil 55. 69.100 / 55. 69.100
libavcodec 57.102.100 / 57.102.100
libavformat 57. 76.100 / 57. 76.100
libavdevice 57. 7.100 / 57. 7.100
libavfilter 6. 95.100 / 6. 95.100
libswscale 4. 7.101 / 4. 7.101
libswresample 2. 8.100 / 2. 8.100
libpostproc 54. 6.100 / 54. 6.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'in.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf57.76.100
Duration: 00:00:55.02, start: 0.000000, bitrate: 354 kb/s
Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 320x240 [SAR 1:1 DAR 4:3], 278 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler
Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 69 kb/s (default)
Metadata:
handler_name : SoundHandler
Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'ol.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf57.76.100
Duration: 00:00:10.02, start: 0.000000, bitrate: 111 kb/s
Stream #1:0(und): Video: h264 (High 4:4:4 Predictive) (avc1 / 0x31637661), yuv444p, 320x240 [SAR 1:1 DAR 4:3], 34 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler
Stream #1:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 69 kb/s (default)
Metadata:
handler_name : SoundHandler
Stream mapping:
Stream #0:0 (h264) -> setpts
Stream #0:1 (aac) -> amix:input0
Stream #1:0 (h264) -> setpts
Stream #1:1 (aac) -> adelay
overlay -> Stream #0:0 (libx264)
amix -> Stream #0:1 (aac)
Press [q] to stop, [?] for help
[libx264 @ 0000000002a41da0] using SAR=1/1
[libx264 @ 0000000002a41da0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0000000002a41da0] profile High, level 1.3
[libx264 @ 0000000002a41da0] 264 - core 152 r2851 ba24899 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'out.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf57.76.100
Stream #0:0: Video: h264 (libx264) (avc1 / 0x31637661), yuv420p(progressive), 320x240 [SAR 1:1 DAR 4:3], q=-1--1, 25 fps, 12800 tbn, 25 tbc (default)
Metadata:
encoder : Lavc57.102.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 69 kb/s (default)
Metadata:
encoder : Lavc57.102.100 aac
[Parsed_overlay_2 @ 00000000003cd5a0] [framesync @ 00000000047c0328] Buffer queue overflow, dropping.
Last message repeated 115 times
frame= 328 fps=0.0 q=28.0 size= 256kB time=00:00:13.07 bitrate= 160.4kbits/s speed=26.1x
frame= 709 fps=709 q=28.0 size= 768kB time=00:00:28.32 bitrate= 222.1kbits/s speed=28.3x
frame= 1054 fps=703 q=28.0 size= 1280kB time=00:00:42.16 bitrate= 248.7kbits/s speed=28.1x
frame= 1375 fps=695 q=-1.0 Lsize= 2007kB time=00:00:55.00 bitrate= 298.8kbits/s speed=27.8x
video:1496kB audio:464kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 2.348816%
[libx264 @ 0000000002a41da0] frame I:7 Avg QP:17.46 size: 5572
[libx264 @ 0000000002a41da0] frame P:391 Avg QP:23.73 size: 1686
[libx264 @ 0000000002a41da0] frame B:977 Avg QP:28.18 size: 853
[libx264 @ 0000000002a41da0] consecutive B-frames: 2.0% 7.1% 8.3% 82.6%
[libx264 @ 0000000002a41da0] mb I I16..4: 44.1% 27.7% 28.2%
[libx264 @ 0000000002a41da0] mb P I16..4: 2.1% 3.9% 1.0% P16..4: 14.1% 8.5% 5.9% 0.0% 0.0% skip:64.4%
[libx264 @ 0000000002a41da0] mb B I16..4: 0.2% 0.1% 0.1% B16..8: 17.2% 5.4% 1.5% direct: 2.2% skip:73.4% L0:50.9% L1:44.2% BI: 4.9%
[libx264 @ 0000000002a41da0] 8x8 transform intra:48.4% inter:34.6%
[libx264 @ 0000000002a41da0] coded y,uvDC,uvAC intra: 12.0% 35.6% 29.4% inter: 4.3% 13.3% 10.9%
[libx264 @ 0000000002a41da0] i16 v,h,dc,p: 72% 20% 6% 2%
[libx264 @ 0000000002a41da0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 10% 10% 78% 1% 0% 0% 0% 0% 1%
[libx264 @ 0000000002a41da0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 38% 22% 31% 1% 1% 1% 2% 1% 2%
[libx264 @ 0000000002a41da0] i8c dc,h,v,p: 47% 18% 33% 2%
[libx264 @ 0000000002a41da0] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0000000002a41da0] ref P L0: 59.3% 8.1% 20.0% 12.6%
[libx264 @ 0000000002a41da0] ref B L0: 80.6% 15.8% 3.6%
[libx264 @ 0000000002a41da0] ref B L1: 94.3% 5.7%
[libx264 @ 0000000002a41da0] kb/s:222.77
[aac @ 000000000031d160] Qavg: 1015.382
# 3 Overlay with no audio - output normal
ffmpeg -i in.mp4 -i ol.mp4 -strict -2 -filter_complex \ "[0:v]setpts=PTS-STARTPTS[v0];[1:v]setpts=PTS-STARTPTS+5/TB[v1]; \ [v0][v1]overlay=(main_w-overlay_w)/2:(main_h-overlay_h)/2:eof_action=pass[outv]" \ -map [outv] out-noaud.mp4
ffmpeg version N-86920-g1193301 Copyright (c) 2000-2017 the FFmpeg developers
built with gcc 7.1.0 (GCC)
configuration: --enable-gpl --enable-version3 --enable-cuda --enable-cuvid --enable-d3d11va --enable-dxva2 --enable-libmfx --enable-nvenc --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-zlib
libavutil 55. 69.100 / 55. 69.100
libavcodec 57.102.100 / 57.102.100
libavformat 57. 76.100 / 57. 76.100
libavdevice 57. 7.100 / 57. 7.100
libavfilter 6. 95.100 / 6. 95.100
libswscale 4. 7.101 / 4. 7.101
libswresample 2. 8.100 / 2. 8.100
libpostproc 54. 6.100 / 54. 6.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'in.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf57.76.100
Duration: 00:00:55.02, start: 0.000000, bitrate: 354 kb/s
Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 320x240 [SAR 1:1 DAR 4:3], 278 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler
Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 69 kb/s (default)
Metadata:
handler_name : SoundHandler
Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'ol.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf57.76.100
Duration: 00:00:10.02, start: 0.000000, bitrate: 111 kb/s
Stream #1:0(und): Video: h264 (High 4:4:4 Predictive) (avc1 / 0x31637661), yuv444p, 320x240 [SAR 1:1 DAR 4:3], 34 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler
Stream #1:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 69 kb/s (default)
Metadata:
handler_name : SoundHandler
Stream mapping:
Stream #0:0 (h264) -> setpts
Stream #1:0 (h264) -> setpts
overlay -> Stream #0:0 (libx264)
Press [q] to stop, [?] for help
[libx264 @ 0000000000547f60] using SAR=1/1
[libx264 @ 0000000000547f60] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0000000000547f60] profile High, level 1.3
[libx264 @ 0000000000547f60] 264 - core 152 r2851 ba24899 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'out-noaud.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf57.76.100
Stream #0:0: Video: h264 (libx264) (avc1 / 0x31637661), yuv420p, 320x240 [SAR 1:1 DAR 4:3], q=-1--1, 25 fps, 12800 tbn, 25 tbc (default)
Metadata:
encoder : Lavc57.102.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
frame= 614 fps=0.0 q=28.0 size= 256kB time=00:00:22.44 bitrate= 93.5kbits/s speed=44.9x
frame= 1143 fps=1143 q=28.0 size= 1024kB time=00:00:43.60 bitrate= 192.4kbits/s speed=43.6x
frame= 1375 fps=1092 q=-1.0 Lsize= 1515kB time=00:00:54.88 bitrate= 226.2kbits/s speed=43.6x
video:1499kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 1.111186%
[libx264 @ 0000000000547f60] frame I:6 Avg QP:16.11 size: 5481
[libx264 @ 0000000000547f60] frame P:394 Avg QP:23.82 size: 1700
[libx264 @ 0000000000547f60] frame B:975 Avg QP:28.20 size: 853
[libx264 @ 0000000000547f60] consecutive B-frames: 2.1% 7.3% 8.3% 82.3%
[libx264 @ 0000000000547f60] mb I I16..4: 51.7% 21.3% 27.1%
[libx264 @ 0000000000547f60] mb P I16..4: 2.2% 3.8% 1.0% P16..4: 14.7% 8.9% 6.1% 0.0% 0.0% skip:63.4%
[libx264 @ 0000000000547f60] mb B I16..4: 0.2% 0.1% 0.1% B16..8: 17.4% 5.3% 1.5% direct: 2.2% skip:73.2% L0:50.9% L1:44.1% BI: 4.9%
[libx264 @ 0000000000547f60] 8x8 transform intra:47.0% inter:34.2%
[libx264 @ 0000000000547f60] coded y,uvDC,uvAC intra: 11.4% 35.0% 28.3% inter: 4.3% 13.5% 11.1%
[libx264 @ 0000000000547f60] i16 v,h,dc,p: 73% 20% 5% 2%
[libx264 @ 0000000000547f60] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 8% 10% 79% 1% 0% 0% 0% 0% 1%
[libx264 @ 0000000000547f60] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 38% 23% 32% 1% 1% 1% 2% 1% 2%
[libx264 @ 0000000000547f60] i8c dc,h,v,p: 46% 18% 34% 2%
[libx264 @ 0000000000547f60] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0000000000547f60] ref P L0: 59.5% 8.3% 20.2% 12.0%
[libx264 @ 0000000000547f60] ref B L0: 80.6% 15.8% 3.5%
[libx264 @ 0000000000547f60] ref B L1: 94.2% 5.8%
[libx264 @ 0000000000547f60] kb/s:223.11
Note:
See TracTickets
for help on using tickets.
Can not reproduce anymore.