Opened 8 years ago

Closed 6 years ago

#5241 closed defect (needs_more_info)

Usage of overlay filter with "dvb_subtitle" stream causes "Buffer queue overflow, dropping." message

Reported by: pth7712 Owned by:
Priority: normal Component: undetermined
Version: git-master Keywords: overlay
Cc: Blocked By:
Blocking: Reproduced by developer: no
Analyzed by developer: no

Description

Summary of the bug:

Usage of overlay filter with "dvb_subtitle" stream causes "Buffer queue overflow, dropping." message. I can
reproduce it only when the input is "live" MPEG-TS.
Overlay filter is used with 0:v as primary and 0:s as secondary stream. The subtitle stream is with DVB bitmap subtitles inside.
Seems like overlay filter doesn't process main input while the secondary is starving.

How to reproduce:

[ffmpeg]# ./ffmpeg -loglevel info  -i "udp://@239.204.5.20:7000?localaddr=10.0.8.36&fifo_size=100000&timeout=10&overrun_nonfatal=1"  -filter_complex [0:v][0:s]overlay=eof_action=pass[v],[v]split=1[out1] -map [out1]  -vcodec libx264 -profile:v  main -preset veryfast -s 1920x1080 -b:v 10000k -minrate 2000k -maxrate 12000k  -bufsize:v 2.8M -pix_fmt yuv420p -g 24 -map 0:s? -c:s copy  -map 0:a:0 -c:a:0 mp2    -map 0:a:0 -c:a:1 libfdk_aac   -flush_packets 0 -f mpegts -mpegts_flags pat_pmt_at_frames -mpegts_flags resend_headers "udp://239.204.5.21:7000?localaddr=10.0.8.36&pkt_size=1316&buffer_size=65536"
ffmpeg version N-78472-g346ec91 Copyright (c) 2000-2016 the FFmpeg developers
  built with gcc 4.8.3 (GCC) 20140911 (Red Hat 4.8.3-9)
  configuration: --enable-shared --enable-gpl --enable-nonfree --enable-libfdk-aac --enable-libmfx --enable-libx264 --extra-libs='-lsupc++ -lstdc++ -ldl -lva -lva-drm -lmfx' --extra-ldflags='-L/opt/intel/mediasdk/lib64 -L/root/ffmpeg_build/lib' --extra-cflags='-I/opt/intel/mediasdk/include -I/root/ffmpeg_build/include' --prefix=/opt/intel/mediasdk
  libavutil      55. 17.103 / 55. 17.103
  libavcodec     57. 24.103 / 57. 24.103
  libavformat    57. 25.100 / 57. 25.100
  libavdevice    57.  0.101 / 57.  0.101
  libavfilter     6. 31.100 /  6. 31.100
  libswscale      4.  0.100 /  4.  0.100
  libswresample   2.  0.101 /  2.  0.101
  libpostproc    54.  0.100 / 54.  0.100
[h264 @ 0x21fa1e0] non-existing PPS 0 referenced
    Last message repeated 1 times
[h264 @ 0x21fa1e0] decode_slice_header error
[h264 @ 0x21fa1e0] no frame!                                                                                                                                                                                                   
[h264 @ 0x21fa1e0] non-existing PPS 0 referenced                                                                                                                                                                               
    Last message repeated 1 times
[h264 @ 0x21fa1e0] decode_slice_header error
[h264 @ 0x21fa1e0] no frame!                                                                                                                                                                                                   
[h264 @ 0x21fa1e0] non-existing PPS 0 referenced                                                                                                                                                                               
    Last message repeated 1 times
[h264 @ 0x21fa1e0] decode_slice_header error
[h264 @ 0x21fa1e0] no frame!                                                                                                                                                                                                   
[h264 @ 0x21fa1e0] non-existing PPS 0 referenced                                                                                                                                                                               
    Last message repeated 1 times
[h264 @ 0x21fa1e0] decode_slice_header error
[h264 @ 0x21fa1e0] no frame!                                                                                                                                                                                                   
[h264 @ 0x21fa1e0] non-existing PPS 0 referenced                                                                                                                                                                               
    Last message repeated 1 times
[h264 @ 0x21fa1e0] decode_slice_header error
[h264 @ 0x21fa1e0] no frame!                                                                                                                                                                                                   
[h264 @ 0x21fa1e0] non-existing PPS 0 referenced                                                                                                                                                                               
    Last message repeated 1 times
[h264 @ 0x21fa1e0] decode_slice_header error
[h264 @ 0x21fa1e0] no frame!                                                                                                                                                                                                   
Input #0, mpegts, from 'udp://@239.204.5.20:7000?localaddr=10.0.8.36&fifo_size=100000&timeout=10&overrun_nonfatal=1':
  Duration: N/A, start: 71388.169367, bitrate: N/A
  Program 307 
    Metadata:
      service_name    : HBO HD
      service_provider: 
    Stream #0:0[0xce7](bul): Audio: mp2 ([4][0][0][0] / 0x0004), 48000 Hz, stereo, s16p, 192 kb/s
    Stream #0:1[0xcee]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc
    Stream #0:2[0xce9](eng): Audio: ac3 ([6][0][0][0] / 0x0006), 48000 Hz, 5.1(side), fltp, 384 kb/s
    Stream #0:3[0x1c9e](bul): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
[mpegts @ 0x21d4cc0] sub2video: using 1920x1080 canvas
[libx264 @ 0x267f140] using SAR=1/1
[libx264 @ 0x267f140] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2
[libx264 @ 0x267f140] profile Main, level 4.0
Output #0, mpegts, to 'udp://239.204.5.21:7000?localaddr=10.0.8.36&pkt_size=1316&buffer_size=65536':
  Metadata:
    encoder         : Lavf57.25.100
    Stream #0:0: Video: h264 (libx264), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], q=-1--1, 10000 kb/s, 25 fps, 90k tbn, 25 tbc (default)
    Metadata:
      encoder         : Lavc57.24.103 libx264
    Side data:
      unknown side data type 10 (24 bytes)
    Stream #0:1(bul): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
    Stream #0:2(bul): Audio: mp2, 48000 Hz, stereo, s16, 384 kb/s
    Metadata:
      encoder         : Lavc57.24.103 mp2
    Stream #0:3(bul): Audio: aac (libfdk_aac), 48000 Hz, stereo, s16, 139 kb/s
    Metadata:
      encoder         : Lavc57.24.103 libfdk_aac
Stream mapping:
  Stream #0:1 (h264) -> overlay:main (graph 0)
  Stream #0:3 (dvbsub) -> overlay:overlay (graph 0)
  split (graph 0) -> Stream #0:0 (libx264)
  Stream #0:3 -> #0:1 (copy)
  Stream #0:0 -> #0:2 (mp2 (native) -> mp2 (native))
  Stream #0:0 -> #0:3 (mp2 (native) -> aac (libfdk_aac))
Press [q] to stop, [?] for help
[h264 @ 0x2bf5240] co located POCs unavailable
[h264 @ 0x2c51fc0] co located POCs unavailable                                                                                                                                                                                 
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=4.32x    
    Last message repeated 42 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=5.64x    
    Last message repeated 26 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=4.35x    
    Last message repeated 12 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=3.48x    
    Last message repeated 12 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=2.93x    
    Last message repeated 12 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=2.61x    
    Last message repeated 12 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=2.37x    
    Last message repeated 13 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=2.22x    
    Last message repeated 13 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=2.07x    
    Last message repeated 11 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.96x    
    Last message repeated 13 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.86x    
    Last message repeated 13 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.82x    
    Last message repeated 12 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.75x    
    Last message repeated 12 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.68x    
    Last message repeated 12 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.63x    
    Last message repeated 11 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.59x    
    Last message repeated 14 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.57x    
    Last message repeated 13 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.53x    
    Last message repeated 12 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.= 1.5x    
    Last message repeated 11 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.47x    
    Last message repeated 12 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.47x    
    Last message repeated 12 times
[Parsed_overlay_0 @ 0x23cc840] [framesync @ 0x239f788] Buffer queue overflow, dropping.=1.45x    
    Last message repeated 9 times
frame=   24 fps=2.0 q=-1.0 Lsize=    2227kB time=00:00:17.02 bitrate=1071.4kbits/s speed=1.39x    
video:932kB audio:1090kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 10.152367%
[libx264 @ 0x267f140] frame I:1     Avg QP: 7.19  size: 82484
[libx264 @ 0x267f140] frame P:13    Avg QP:10.59  size: 49103
[libx264 @ 0x267f140] frame B:10    Avg QP:12.35  size: 23352
[libx264 @ 0x267f140] consecutive B-frames: 16.7% 83.3%  0.0%  0.0%
[libx264 @ 0x267f140] mb I  I16..4: 59.7%  0.0% 40.3%
[libx264 @ 0x267f140] mb P  I16..4: 22.3%  0.0%  3.8%  P16..4: 22.2% 13.2%  7.5%  0.0%  0.0%    skip:31.0%
[libx264 @ 0x267f140] mb B  I16..4:  8.6%  0.0%  0.6%  B16..8: 25.6% 10.8%  1.5%  direct:11.1%  skip:41.8%  L0:47.8% L1:39.7% BI:12.5%
[libx264 @ 0x267f140] coded y,uvDC,uvAC intra: 55.0% 59.7% 45.0% inter: 18.2% 21.3% 3.5%
[libx264 @ 0x267f140] i16 v,h,dc,p: 50% 23% 23%  4%
[libx264 @ 0x267f140] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 33% 28% 20%  3%  3%  3%  3%  3%  3%
[libx264 @ 0x267f140] i8c dc,h,v,p: 64% 16% 17%  3%
[libx264 @ 0x267f140] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0x267f140] kb/s:7952.80
Exiting normally, received signal 2

Change History (5)

in reply to:  description comment:1 by Carl Eugen Hoyos, 8 years ago

Keywords: sync removed

Replying to pth7712:

Usage of overlay filter with "dvb_subtitle" stream causes "Buffer queue overflow, dropping." message. I can reproduce it only when the input is "live" MPEG-TS.

How are we supposed to reproduce the issue?

comment:2 by pth7712, 8 years ago

Hi,
you need a live mpeg-ts stream with dvb subtitles stream. I cannot send multicast over the Internet.
BTW,
maybe related effect occurs when the input is from MPEG-TS file (not a multicast stream). Then the overlying is very slow, but "Buffer queue overflow" doesn't appears. Seems like (but only seems) the overlay waits for subtitle PTS before do something.

comment:3 by pth7712, 8 years ago

Hello,

removing:

-map 0:s? -c:s copy 

from the arguments list, fixes the issue.
Maybe this can help.

comment:4 by Elon Musk, 7 years ago

Does this still happens with latest master?

comment:5 by Carl Eugen Hoyos, 6 years ago

Resolution: needs_more_info
Status: newclosed
Note: See TracTickets for help on using tickets.