`compute_vmaf()` is deprecated, so that cant load feature extractors from float model to calcurate vmaf scores.

[nicol]

Summary of the bug: Error occurs ​Auto-Build 2020-12-23 after.
Using model is ​https://github.com/Netflix/vmaf/tree/master/model
How to reproduce:

% ffmpeg.exe -v 9 -loglevel 99 -f lavfi -i color=d=1:s=1920x1080 -filter_complex "split,libvmaf=vmaf_float_v0.6.1.pkl:psnr=1:log_path=log.csv:log_fmt=csv" -f null -
ffmpeg version Auto-Build 2020-12-23 12:35
built on ... BtbN/FFmpeg-Builds

ffmpeg version N-100459-ga7f9b3b954 Copyright (c) 2000-2020 the FFmpeg developers
  built with gcc 9.3-win32 (GCC) 20200320
  configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-w64-mingw32- --arch=x86_64 --target-os=mingw32 --enable-gpl --enable-version3 --disable-debug --disable-w32threads --enable-pthreads --enable-iconv --enable-zlib --enable-libxml2 --enable-libfreetype --enable-libfribidi --enable-gmp --enable-lzma --enable-fontconfig --enable-opencl --enable-libvmaf --disable-vulkan --enable-libvorbis --enable-amf --enable-libaom --enable-avisynth --enable-libdav1d --enable-libdavs2 --enable-ffnvcodec --enable-cuda-llvm --disable-libglslang --enable-libass --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvpx --enable-libwebp --enable-libmfx --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librav1e --enable-librubberband --enable-schannel --enable-sdl2 --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --enable-libvidstab --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-ldflags=-pthread --extra-libs=-lgomp
  libavutil      56. 62.100 / 56. 62.100
  libavcodec     58.115.102 / 58.115.102
  libavformat    58. 65.100 / 58. 65.100
  libavdevice    58. 11.103 / 58. 11.103
  libavfilter     7. 94.100 /  7. 94.100
  libswscale      5.  8.100 /  5.  8.100
  libswresample   3.  8.100 /  3.  8.100
  libpostproc    55.  8.100 / 55.  8.100
Splitting the commandline.
Reading option '-v' ... matched as option 'v' (set logging level) with argument '9'.
Reading option '-loglevel' ... matched as option 'loglevel' (set logging level) with argument '99'.
Reading option '-f' ... matched as option 'f' (force format) with argument 'lavfi'.
Reading option '-i' ... matched as input url with argument 'color=d=1:s=1920x1080'.
Reading option '-filter_complex' ... matched as option 'filter_complex' (create a complex filtergraph) with argument 'split,libvmaf=vmaf_float_v0.6.1.pkl:psnr=1:log_path=log.csv:log_fmt=csv'.
Reading option '-f' ... matched as option 'f' (force format) with argument 'null'.
Reading option '-' ... matched as output url.
Finished splitting the commandline.
Parsing a group of options: global .
Applying option v (set logging level) with argument 9.
Applying option filter_complex (create a complex filtergraph) with argument split,libvmaf=vmaf_float_v0.6.1.pkl:psnr=1:log_path=log.csv:log_fmt=csv.
Successfully parsed a group of options.
Parsing a group of options: input url color=d=1:s=1920x1080.
Applying option f (force format) with argument lavfi.
Successfully parsed a group of options.
Opening an input file: color=d=1:s=1920x1080.
detected 8 logical cores
[Parsed_color_0 @ 000002209622b400] Setting 'd' to value '1'
[Parsed_color_0 @ 000002209622b400] Setting 's' to value '1920x1080'
[Parsed_color_0 @ 000002209622b400] size:1920x1080 rate:25/1 duration:1.000000 sar:1/1
[AVFilterGraph @ 0000022097e56380] query_formats: 2 queried, 1 merged, 0 already done, 0 delayed
[lavfi @ 0000022097e54e80] All info found
[lavfi @ 0000022097e54e80] stream 0: start_time: 0 duration: NOPTS
[lavfi @ 0000022097e54e80] format: start_time: 0 duration: NOPTS (estimate from bit rate) bitrate=0 kb/s
Input #0, lavfi, from 'color=d=1:s=1920x1080':
  Duration: N/A, start: 0.000000, bitrate: N/A
    Stream #0:0, 1, 1/25: Video: rawvideo, 1 reference frame (I420 / 0x30323449), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 0/1, 25 tbr, 25 tbn, 25 tbc
Successfully opened the file.
[Parsed_libvmaf_1 @ 0000022097edc540] Setting 'model_path' to value 'vmaf_float_v0.6.1.pkl'
[Parsed_libvmaf_1 @ 0000022097edc540] Setting 'psnr' to value '1'
[Parsed_libvmaf_1 @ 0000022097edc540] Setting 'log_path' to value 'log.csv'
[Parsed_libvmaf_1 @ 0000022097edc540] Setting 'log_fmt' to value 'csv'
Parsing a group of options: output url -.
Applying option f (force format) with argument null.
Successfully parsed a group of options.
Opening an output file: -.
Successfully opened the file.
Stream mapping:
  Stream #0:0 (rawvideo) -> split
  libvmaf -> Stream #0:0 (wrapped_avframe)
Press [q] to stop, [?] for help
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless if it occurs once at the start per stream)
[rawvideo @ 00000220981c0940] PACKET SIZE: 3110400, STRIDE: 2880
[Parsed_libvmaf_1 @ 0000022097edbb40] Setting 'model_path' to value 'vmaf_float_v0.6.1.pkl'
[Parsed_libvmaf_1 @ 0000022097edbb40] Setting 'psnr' to value '1'
[Parsed_libvmaf_1 @ 0000022097edbb40] Setting 'log_path' to value 'log.csv'
[Parsed_libvmaf_1 @ 0000022097edbb40] Setting 'log_fmt' to value 'csv'
[graph 0 input from stream 0:0 @ 0000022097edca40] Setting 'video_size' to value '1920x1080'
[graph 0 input from stream 0:0 @ 0000022097edca40] Setting 'pix_fmt' to value '0'
[graph 0 input from stream 0:0 @ 0000022097edca40] Setting 'time_base' to value '1/25'
[graph 0 input from stream 0:0 @ 0000022097edca40] Setting 'pixel_aspect' to value '1/1'
[graph 0 input from stream 0:0 @ 0000022097edca40] Setting 'frame_rate' to value '25/1'
[graph 0 input from stream 0:0 @ 0000022097edca40] w:1920 h:1080 pixfmt:yuv420p tb:1/25 fr:25/1 sar:1/1
[AVFilterGraph @ 00000220981c07c0] query_formats: 4 queried, 3 merged, 1 already done, 0 delayed
[Parsed_libvmaf_1 @ 0000022097edbb40] [framesync @ 0000022097ee7448] Selected 1/25 time base
[Parsed_libvmaf_1 @ 0000022097edbb40] [framesync @ 0000022097ee7448] Sync level 2
libvmaf INFO `compute_vmaf()` is deprecated and will be removed in a future libvmaf version
libvmaf WARNING could not read model from path: "vmaf_float_v0.6.1.pkl"
libvmaf WARNING pkl model files have been deprecated, use json
libvmaf ERROR problem loading model file: vmaf_float_v0.6.1.pkl
[Parsed_libvmaf_1 @ 0000022097edbb40] libvmaf encountered an error, check log for details
Error while filtering: Invalid argument
Failed to inject frame into filter network: Invalid argument
Error while processing the decoded data for stream #0:0
Conversion failed!

Patches should be submitted to the ffmpeg-devel mailing list and not this bug tracker.

[Elon Musk]

If nobody step up to fix this, filter will be eventually removed from libavfilter.

[Carl Eugen Hoyos]

I wonder what is reported here: Description and title do not match.

[nicol]

I don't know how to fix the error, but I hope it will help everyone to know that there is an error.

[Carl Eugen Hoyos]

Which error do you mean?

[nicol]

libvmaf INFO compute_vmaf() is deprecated and will be removed in a future libvmaf version
libvmaf WARNING could not read model from path: "vmaf_float_v0.6.1.pkl"
libvmaf WARNING pkl model files have been deprecated, use json
libvmaf ERROR problem loading model file: vmaf_float_v0.6.1.pkl
[Parsed_libvmaf_1 @ 0000022097edbb40] libvmaf encountered an error, check log for details

Error that the model file could not be read.

[Carl Eugen Hoyos]

This appears to contradict this ticket‘s title, no?

[nicol]

Changed .pkl to .json and title.

% ffmpeg.exe -v 9 -loglevel 99 -f lavfi -i color=d=1:s=1920x1080 -filter_complex "split,libvmaf=vmaf_float_v0.6.1.json:log_path=log.csv:log_fmt=csv" -f null -

ffmpeg version N-100459-ga7f9b3b954 Copyright (c) 2000-2020 the FFmpeg developers
  built with gcc 9.3-win32 (GCC) 20200320
  configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-w64-mingw32- --arch=x86_64 --target-os=mingw32 --enable-gpl --enable-version3 --disable-debug --disable-w32threads --enable-pthreads --enable-iconv --enable-zlib --enable-libxml2 --enable-libfreetype --enable-libfribidi --enable-gmp --enable-lzma --enable-fontconfig --enable-opencl --enable-libvmaf --disable-vulkan --enable-libvorbis --enable-amf --enable-libaom --enable-avisynth --enable-libdav1d --enable-libdavs2 --enable-ffnvcodec --enable-cuda-llvm --disable-libglslang --enable-libass --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvpx --enable-libwebp --enable-libmfx --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librav1e --enable-librubberband --enable-schannel --enable-sdl2 --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --enable-libvidstab --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-ldflags=-pthread --extra-libs=-lgomp
  libavutil      56. 62.100 / 56. 62.100
  libavcodec     58.115.102 / 58.115.102
  libavformat    58. 65.100 / 58. 65.100
  libavdevice    58. 11.103 / 58. 11.103
  libavfilter     7. 94.100 /  7. 94.100
  libswscale      5.  8.100 /  5.  8.100
  libswresample   3.  8.100 /  3.  8.100
  libpostproc    55.  8.100 / 55.  8.100
Splitting the commandline.
Reading option '-v' ... matched as option 'v' (set logging level) with argument '9'.
Reading option '-loglevel' ... matched as option 'loglevel' (set logging level) with argument '99'.
Reading option '-f' ... matched as option 'f' (force format) with argument 'lavfi'.
Reading option '-i' ... matched as input url with argument 'color=d=1:s=1920x1080'.
Reading option '-filter_complex' ... matched as option 'filter_complex' (create a complex filtergraph) with argument 'split,libvmaf=vmaf_float_v0.6.1.json:log_path=log.csv:log_fmt=csv'.
Reading option '-f' ... matched as option 'f' (force format) with argument 'null'.
Reading option '-' ... matched as output url.
Finished splitting the commandline.
Parsing a group of options: global .
Applying option v (set logging level) with argument 9.
Applying option filter_complex (create a complex filtergraph) with argument split,libvmaf=vmaf_float_v0.6.1.json:log_path=log.csv:log_fmt=csv.
Successfully parsed a group of options.
Parsing a group of options: input url color=d=1:s=1920x1080.
Applying option f (force format) with argument lavfi.
Successfully parsed a group of options.
Opening an input file: color=d=1:s=1920x1080.
detected 8 logical cores
[Parsed_color_0 @ 0000025ade1d6e40] Setting 'd' to value '1'
[Parsed_color_0 @ 0000025ade1d6e40] Setting 's' to value '1920x1080'
[Parsed_color_0 @ 0000025ade1d6e40] size:1920x1080 rate:25/1 duration:1.000000 sar:1/1
[AVFilterGraph @ 0000025ade1d6340] query_formats: 2 queried, 1 merged, 0 already done, 0 delayed
[lavfi @ 0000025ade1d4e40] All info found
[lavfi @ 0000025ade1d4e40] stream 0: start_time: 0 duration: NOPTS
[lavfi @ 0000025ade1d4e40] format: start_time: 0 duration: NOPTS (estimate from bit rate) bitrate=0 kb/s
Input #0, lavfi, from 'color=d=1:s=1920x1080':
  Duration: N/A, start: 0.000000, bitrate: N/A
    Stream #0:0, 1, 1/25: Video: rawvideo, 1 reference frame (I420 / 0x30323449), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 0/1, 25 tbr, 25 tbn, 25 tbc
Successfully opened the file.
[Parsed_libvmaf_1 @ 0000025ade25c340] Setting 'model_path' to value 'vmaf_float_v0.6.1.json'
[Parsed_libvmaf_1 @ 0000025ade25c340] Setting 'log_path' to value 'log.csv'
[Parsed_libvmaf_1 @ 0000025ade25c340] Setting 'log_fmt' to value 'csv'
Parsing a group of options: output url -.
Applying option f (force format) with argument null.
Successfully parsed a group of options.
Opening an output file: -.
Successfully opened the file.
Stream mapping:
  Stream #0:0 (rawvideo) -> split
  libvmaf -> Stream #0:0 (wrapped_avframe)
Press [q] to stop, [?] for help
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless if it occurs once at the start per stream)
[rawvideo @ 0000025ade940b40] PACKET SIZE: 3110400, STRIDE: 2880
[Parsed_libvmaf_1 @ 0000025ade25b440] Setting 'model_path' to value 'vmaf_float_v0.6.1.json'
[Parsed_libvmaf_1 @ 0000025ade25b440] Setting 'log_path' to value 'log.csv'
[Parsed_libvmaf_1 @ 0000025ade25b440] Setting 'log_fmt' to value 'csv'
[graph 0 input from stream 0:0 @ 0000025ade25c740] Setting 'video_size' to value '1920x1080'
[graph 0 input from stream 0:0 @ 0000025ade25c740] Setting 'pix_fmt' to value '0'
[graph 0 input from stream 0:0 @ 0000025ade25c740] Setting 'time_base' to value '1/25'
[graph 0 input from stream 0:0 @ 0000025ade25c740] Setting 'pixel_aspect' to value '1/1'
[graph 0 input from stream 0:0 @ 0000025ade25c740] Setting 'frame_rate' to value '25/1'
[graph 0 input from stream 0:0 @ 0000025ade25c740] w:1920 h:1080 pixfmt:yuv420p tb:1/25 fr:25/1 sar:1/1
[AVFilterGraph @ 0000025ade93ff00] query_formats: 4 queried, 3 merged, 1 already done, 0 delayed
[Parsed_libvmaf_1 @ 0000025ade25b440] [framesync @ 0000025ade267008] Selected 1/25 time base
[Parsed_libvmaf_1 @ 0000025ade25b440] [framesync @ 0000025ade267008] Sync level 2
libvmaf INFO `compute_vmaf()` is deprecated and will be removed in a future libvmaf version
Output #0, null, to 'pipe:':
  Metadata:
    encoder         : Lavf58.65.100
    Stream #0:0, 0, 1/25: Video: wrapped_avframe, 1 reference frame, yuv420p(progressive), 1920x1080 (0x0) [SAR 1:1 DAR 16:9], 0/1, q=2-31, 200 kb/s, 25 fps, 25 tbn
    Metadata:
      encoder         : Lavc58.115.102 wrapped_avframe
frame=    1 fps=0.0 q=-0.0 size=N/A time=00:00:00.04 bitrate=N/A speed=N/A    
[rawvideo @ 0000025ade940b40] PACKET SIZE: 3110400, STRIDE: 2880
libvmaf ERROR problem loading feature extractors from model file: vmaf_float_v0.6.1.json
[Parsed_libvmaf_1 @ 0000025ade25b440] libvmaf encountered an error, check log for details
Error while filtering: Invalid argument
Failed to inject frame into filter network: Invalid argument
Error while processing the decoded data for stream #0:0
Conversion failed!

libvmaf INFO compute_vmaf() is deprecated and will be removed in a future libvmaf version
libvmaf ERROR problem loading feature extractors from model file: vmaf_float_v0.6.1.json

I changed it to json and it still load feature.

[Carl Eugen Hoyos]

Don’t you think that it is very unlikely that the warning and the error message are related?

[nicol]

I don't understand the relationship between warning and the error message,but using gyan.dev the same.
1/1, SHA256: c9e4b6cae03d41875e337e178f194ee79ef2775a71150fd67fef55b07ccb2d9c
​https://www.gyan.dev/ffmpeg/builds/ffmpeg-git-full.7z

[pdr0]

Works ok for me using gyan's builds on windows

Verify that your downloaded json is correct (open in a text editor)

The escapes were different than in the vmaf documentation for me. They said you needed 2 escapes for the colon, it worked with 1 like libvmaf 1.0
​https://github.com/Netflix/vmaf/blob/master/resource/doc/ffmpeg.md

-lavfi "libvmaf=log_fmt=xml:model_path='D\:/VMAF v2.1.0/vmaf_v0.6.1.json':log_path='F\:/TEST/test.xml'"

[nicol]

Thanks for testing. I retried with full path.

Without float models are ok.
ffmpeg.exe -f lavfi -i color=d=1:s=1920x1080 -f lavfi -i color=d=1:s=1920x1080 -lavfi "[0:v]setpts=PTS-STARTPTS[reference];[1:v]setpts=PTS-STARTPTS[distorted];[distorted][reference]libvmaf=log_fmt=csv:model_path='F\:/vmaf/vmaf_v0.6.1.json':log_path='F\:/vmaf/test.csv" -f null -
ffmpeg.exe -f lavfi -i color=d=1:s=1920x1080 -f lavfi -i color=d=1:s=1920x1080 -lavfi "[0:v]setpts=PTS-STARTPTS[reference];[1:v]setpts=PTS-STARTPTS[distorted];[distorted][reference]libvmaf=log_fmt=csv:model_path='F\:/vmaf/vmaf_v0.6.1neg.json':log_path='F\:/vmaf/test.csv" -f null -

But with float models converte failed.
ffmpeg.exe -f lavfi -i color=d=1:s=1920x1080 -f lavfi -i color=d=1:s=1920x1080 -lavfi "[0:v]setpts=PTS-STARTPTS[reference];[1:v]setpts=PTS-STARTPTS[distorted];[distorted][reference]libvmaf=log_fmt=csv:model_path='F\:/vmaf/vmaf_float_v0.6.1.json':log_path='F\:/vmaf/test_float.csv" -f null -

ffmpeg version 2021-01-01-git-63505fc60a-full_build-www.gyan.dev Copyright (c) 2000-2021 the FFmpeg developers
  built with gcc 10.2.0 (Rev5, Built by MSYS2 project)
  configuration: --enable-gpl --enable-version3 --enable-static --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-lzma --enable-libsnappy --enable-zlib --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libdav1d --enable-libzvbi --enable-librav1e --enable-libsvtav1 --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxvid --enable-libaom --enable-libopenjpeg --enable-libvpx --enable-libass --enable-frei0r --enable-libfreetype --enable-libfribidi --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-ffnvcodec --enable-nvdec --enable-nvenc --enable-d3d11va --enable-dxva2 --enable-libmfx --enable-libglslang --enable-vulkan --enable-opencl --enable-libcdio --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libvo-amrwbenc --enable-libilbc --enable-libgsm --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libflite --enable-libmysofa --enable-librubberband --enable-libsoxr --enable-chromaprint
  libavutil      56. 62.100 / 56. 62.100
  libavcodec     58.115.102 / 58.115.102
  libavformat    58. 65.100 / 58. 65.100
  libavdevice    58. 11.103 / 58. 11.103
  libavfilter     7. 94.100 /  7. 94.100
  libswscale      5.  8.100 /  5.  8.100
  libswresample   3.  8.100 /  3.  8.100
  libpostproc    55.  8.100 / 55.  8.100
Input #0, lavfi, from 'color=d=1:s=1920x1080':
  Duration: N/A, start: 0.000000, bitrate: N/A
    Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 25 tbr, 25 tbn, 25 tbc
Input #1, lavfi, from 'color=d=1:s=1920x1080':
  Duration: N/A, start: 0.000000, bitrate: N/A
    Stream #1:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 25 tbr, 25 tbn, 25 tbc
Stream mapping:
  Stream #0:0 (rawvideo) -> setpts
  Stream #1:0 (rawvideo) -> setpts
  libvmaf -> Stream #0:0 (wrapped_avframe)
Press [q] to stop, [?] for help
libvmaf INFO `compute_vmaf()` is deprecated and will be removed in a future libvmaf version
Output #0, null, to 'pipe:':
  Metadata:
    encoder         : Lavf58.65.100
    Stream #0:0: Video: wrapped_avframe, yuv420p(progressive), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn (default)
    Metadata:
      encoder         : Lavc58.115.102 wrapped_avframe
frame=    1 fps=0.0 q=-0.0 size=N/A time=00:00:00.04 bitrate=N/A speed=91.3x    
libvmaf ERROR problem loading feature extractors from model file: F:/vmaf/vmaf_float_v0.6.1.json
[Parsed_libvmaf_2 @ 00000233e3fe2ac0] libvmaf encountered an error, check log for details
Error while filtering: Invalid argument
Failed to inject frame into filter network: Invalid argument
Error while processing the decoded data for stream #1:0
Conversion failed!

Files put on F drive.
F:\vmaf
ffmpeg.exe
other_models
vmaf_4k_rb_v0.6.2
vmaf_4k_v0.6.1.json
vmaf_4k_v0.6.1.pkl
vmaf_4k_v0.6.1.pkl.model
vmaf_b_v0.6.3.json
vmaf_float_4k_v0.6.1.json
vmaf_float_b_v0.6.3
vmaf_float_b_v0.6.3.json
vmaf_float_v0.6.1.json
vmaf_float_v0.6.1.pkl
vmaf_float_v0.6.1.pkl.model
vmaf_float_v0.6.1neg.json
vmaf_float_v0.6.1neg.pkl
vmaf_float_v0.6.1neg.pkl.model
vmaf_rb_v0.6.2
vmaf_rb_v0.6.3
vmaf_v0.6.1.json
vmaf_v0.6.1neg.json

[Carl Eugen Hoyos]

Please move the discussion to the user mailing list.

[Gyan]

Kyle has mentioned he's working on updating the avfilter wrapper at ​https://github.com/Netflix/vmaf/issues/753#issuecomment-740787078

Ping him if you're interested.