Certain H.264 videos cannot decode with videotoolbox

[forthrin]

For reasons unknown, a percentage of H.264 videos fail to hardware decode with videotoolbox.

Enclosed is a dozen different single frame specimens that all cause the same problem and should thus help quickly identify and resolve the issue.

$ ffmpeg -hwaccel videotoolbox -i 01.mp4 -xerror -f mp4 -y /dev/null
ffmpeg version git-2021-11-21-18f22bf Copyright (c) 2000-2021 the FFmpeg developers
  built with Apple clang version 12.0.5 (clang-1205.0.22.9)
  configuration: --enable-nonfree --enable-gpl --enable-libass --enable-libx264 --enable-libx265 --enable-libssh --enable-libzimg --enable-opencl --enable-libmp3lame
  libavutil      57.  9.100 / 57.  9.100
  libavcodec     59. 13.100 / 59. 13.100
  libavformat    59.  9.101 / 59.  9.101
  libavdevice    59.  0.101 / 59.  0.101
  libavfilter     8. 17.100 /  8. 17.100
  libswscale      6.  1.100 /  6.  1.100
  libswresample   4.  0.100 /  4.  0.100
  libpostproc    56.  0.100 / 56.  0.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '01.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
  Duration: 00:00:00.04, start: 0.000000, bitrate: 402 kb/s
  Stream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(progressive), 1920x1080 [SAR 1:1 DAR 16:9], 244 kb/s, 23.99 fps, 23.99 tbr, 16k tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
Press [q] to stop, [?] for help
Error creating Videotoolbox decoder.
videotoolbox hwaccel requested for input stream #0:0, but cannot be initialized.
[h264 @ 0x7fce00d13580] decode_slice_header error
[h264 @ 0x7fce00d13580] no frame!
Conversion failed!
$