Opened 5 years ago

Closed 5 years ago

Last modified 5 years ago

#8155 closed defect (invalid)

Transcoded network streams are containing several errors.

Reported by: Leslie.H Owned by:
Priority: normal Component: undetermined
Version: unspecified Keywords:
Cc: laszlo.havasi@gmail.com Blocked By:
Blocking: Reproduced by developer: no
Analyzed by developer: no

Description

I was updating the ffmpeg components on a common stream recording server. The result is terrible. The video quality changed to unacceptable. I didn’t modify anything, only replaced the ffmpeg static Windows builds.

You can check the attached files:

cmd_new.bat is the command which has the output film_new.mkv. The full console log is console_new.txt.

cmd_old.bat is the command which has the output film_old.mkv. The full console log is console_old.txt.

It seems a critical bug.

Attachments (15)

film_old.mkv (2.0 MB ) - added by Leslie.H 5 years ago.
film_new.mkv (2.0 MB ) - added by Leslie.H 5 years ago.
cmd_old.bat (309 bytes ) - added by Leslie.H 5 years ago.
cmd_new.bat (309 bytes ) - added by Leslie.H 5 years ago.
console_old.txt (977.2 KB ) - added by Leslie.H 5 years ago.
console_new.txt (1.5 MB ) - added by Leslie.H 5 years ago.
film_old_2.mkv (1.9 MB ) - added by Leslie.H 5 years ago.
film_new_2.mkv (1.9 MB ) - added by Leslie.H 5 years ago.
console_new_2.txt (1.4 MB ) - added by Leslie.H 5 years ago.
console_old_2.txt (889.6 KB ) - added by Leslie.H 5 years ago.
cmd_new_2.bat (248 bytes ) - added by Leslie.H 5 years ago.
cmd_old_2.bat (248 bytes ) - added by Leslie.H 5 years ago.
console_1dcb5b7.txt (1.3 MB ) - added by Leslie.H 5 years ago.
film_1dcb5b7.mkv (1.9 MB ) - added by Leslie.H 5 years ago.
console_new_pthread.txt (467.3 KB ) - added by Leslie.H 5 years ago.

Change History (31)

by Leslie.H, 5 years ago

Attachment: film_old.mkv added

by Leslie.H, 5 years ago

Attachment: film_new.mkv added

by Leslie.H, 5 years ago

Attachment: cmd_old.bat added

by Leslie.H, 5 years ago

Attachment: cmd_new.bat added

by Leslie.H, 5 years ago

Attachment: console_old.txt added

by Leslie.H, 5 years ago

Attachment: console_new.txt added

comment:1 by Leslie.H, 5 years ago

Cc: laszlo.havasi@gmail.com added

comment:2 by mkver, 5 years ago

The first thing I see is that the log for the new build contains:

[udp @ 000000bfad4abe00] 'overrun_nonfatal' option was set but it is not supported on this build (pthread support is required)
[udp @ 000000bfad4abe00] 'circular_buffer_size' option was set but it is not supported on this build (pthread support is required)

Which means that you should test a build with pthreads.

in reply to:  2 comment:3 by Leslie.H, 5 years ago

Yes. I know, but there is no effect of these options. The output has the same errors when I remove these options.

by Leslie.H, 5 years ago

Attachment: film_old_2.mkv added

comment:4 by mkver, 5 years ago

Of course removing these options from a build without pthreads doesn't change anything, because they are not supported (i.e. even if you set those options, they are not really active). As I said: Test a build with pthreads.

(If I am not mistaken, then this project can be used to build ffmpeg with pthreads.)

by Leslie.H, 5 years ago

Attachment: film_new_2.mkv added

by Leslie.H, 5 years ago

Attachment: console_new_2.txt added

by Leslie.H, 5 years ago

Attachment: console_old_2.txt added

by Leslie.H, 5 years ago

Attachment: cmd_new_2.bat added

by Leslie.H, 5 years ago

Attachment: cmd_old_2.bat added

in reply to:  4 comment:5 by Leslie.H, 5 years ago

I have uploaded the outputs without the options for both old and new ffmpeg build.
I think the new ffmpeg should generate good outputs wihtout pthread.

Of course removing these options from a build without pthreads doesn't change anything, because they are not supported (i.e. even if you set those options, they are not really active). As I said: Test a build with pthreads.

(If I am not mistaken, then this project can be used to build ffmpeg with pthreads.)

comment:6 by mkver, 5 years ago

Can you pinpoint the first occurence of the bug using e.g. old zeranoe builds?

in reply to:  6 comment:7 by Leslie.H, 5 years ago

The oldest available version is:
ffmpeg-20190101-1dcb5b7-win64-static.zip

The output has the same errors.

Can you pinpoint the first occurence of the bug using e.g. old zeranoe builds?

by Leslie.H, 5 years ago

Attachment: console_1dcb5b7.txt added

by Leslie.H, 5 years ago

Attachment: film_1dcb5b7.mkv added

in reply to:  6 comment:8 by Leslie.H, 5 years ago

I used this site to download the older versions:

https://www.videohelp.com/software/ffmpeg/old-versions

Based on the tests, the result is the following:
The last good version is:

ffmpeg-20161207-6b95da9-win64-static.zip 2016-12-07

ffmpeg version N-82785-g6b95da9 Copyright (c) 2000-2016 the FFmpeg developers

built with gcc 5.4.0 (GCC)
configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-dxva2 --enable-libmfx --enable-nvenc --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib
libavutil 55. 41.101 / 55. 41.101
libavcodec 57. 66.109 / 57. 66.109
libavformat 57. 58.101 / 57. 58.101
libavdevice 57. 2.100 / 57. 2.100
libavfilter 6. 68.100 / 6. 68.100
libswscale 4. 3.101 / 4. 3.101
libswresample 2. 4.100 / 2. 4.100
libpostproc 54. 2.100 / 54. 2.100

The next version with errors is:

ffmpeg-3.2.2-win64-static.zip 2016-12-17

ffmpeg version 3.2.2 Copyright (c) 2000-2016 the FFmpeg developers

built with gcc 5.4.0 (GCC)
configuration: --enable-gpl --enable-version3 --enable-dxva2 --enable-libmfx --enable-nvenc --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib
libavutil 55. 34.100 / 55. 34.100
libavcodec 57. 64.101 / 57. 64.101
libavformat 57. 56.100 / 57. 56.100
libavdevice 57. 1.100 / 57. 1.100
libavfilter 6. 65.100 / 6. 65.100
libswscale 4. 2.100 / 4. 2.100
libswresample 2. 3.100 / 2. 3.100
libpostproc 54. 1.100 / 54. 1.100

I hope it can help.

Can you pinpoint the first occurence of the bug using e.g. old zeranoe builds?

comment:9 by mkver, 5 years ago

The last working version has -disable-w32threads, the version with errors is missing this. In other words: This really seems to be an issue about w32threads vs pthreads.

[Edit]: You are comparing an old release of a branch with a snapshot of git master. This is wrong. See, developement of FFmpeg (and lots of other software projects) works roughly as follows:
When the time is right, a new release is made. This is what most package maintainers use. New features and bugfixes (which might introduce regressions) are then added to the "master" branch and aren't incorporated into the release branches by default (unless they fix a bug that was already present in the release branch and if the patch applies to the release branch at all and if it doesn't change API/ABI compability). You can see this above: The libavformat versions are 57.56.100 vs 57.58.101.

Last edited 5 years ago by mkver (previous) (diff)

in reply to:  9 comment:10 by Leslie.H, 5 years ago

I also tested 3.2. Which is a good version:

ffmpeg version 3.2 Copyright (c) 2000-2016 the FFmpeg developers
built with gcc 5.4.0 (GCC)
configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-dxva2 --enable-libmfx --enable-nvenc --enable-avisynth --enable-bzlib --enable-libebur128 --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib
libavutil 55. 34.100 / 55. 34.100
libavcodec 57. 64.100 / 57. 64.100
libavformat 57. 56.100 / 57. 56.100
libavdevice 57. 1.100 / 57. 1.100
libavfilter 6. 65.100 / 6. 65.100
libswscale 4. 2.100 / 4. 2.100
libswresample 2. 3.100 / 2. 3.100
libpostproc 54. 1.100 / 54. 1.100

Can anybody build a new win64 static and dynamic build without w32thread?
I could test it.

Replying to mkver:

The last working version has -disable-w32threads, the version with errors is missing this. In other words: This really seems to be an issue about w32threads vs pthreads.

[Edit]: You are comparing an old release of a branch with a snapshot of git master. This is wrong. See, developement of FFmpeg (and lots of other software projects) works roughly as follows:
When the time is right, a new release is made. This is what most package maintainers use. New features and bugfixes (which might introduce regressions) are then added to the "master" branch and aren't incorporated into the release branches by default (unless they fix a bug that was already present in the release branch and if the patch applies to the release branch at all and if it doesn't change API/ABI compability). You can see this above: The libavformat versions are 57.56.100 vs 57.58.101.

comment:11 by mkver, 5 years ago

Here are some builds to try.

by Leslie.H, 5 years ago

Attachment: console_new_pthread.txt added

comment:12 by Leslie.H, 5 years ago

Thank you!
Results are not too promising:

  1. winthreads version has the errors in the output file.
  2. pthread version didn't generate output file. I had to add fifo_size because circular buffer overrun messages were generated. I attached the console log. The exit was hard, because the ffmpeg was halted (?).

comment:13 by Leslie.H, 5 years ago

May we say that, it is not possible to solve?

comment:14 by Marton Balint, 5 years ago

Using a big enough buffer_size should fix this. Threading for UDP input is not really needed if the kernel buffers all input. And you set the kernel (socket) UDP buffer size with the buffer_size option.

comment:15 by Marton Balint, 5 years ago

Resolution: invalid
Status: newclosed

User confirmed that increasing buffer_size fixes this.

comment:16 by Carl Eugen Hoyos, 5 years ago

Version: 4.2unspecified
Note: See TracTickets for help on using tickets.