aresample hangs indefinitely

[fabi123]

Summary of the bug: Aresample hangs indefinitely on some inputs (tesed with soxr)
How to reproduce:

% yt-dlp -f 251 https://www.youtube.com/watch\?v\=qMzlXzuUENY -o SATTA.webm
...
% ./ffmpeg -y -i SATTA.webm -af "loudnorm=I=-16.0:TP=-1.0:LRA=20.0:measured_I=-19.18:measured_LRA=10.20:measured_TP=-2.89:measured_thresh=-30.09:offset=-1.81:linear=true,aresample=resampler=soxr:out_sample_rate=48000:precision=33,aformat=channel_layouts=stereo" -c:a libopus SATTA.opus
ffmpeg version N-111340-ga196d02e86 Copyright (c) 2000-2023 the FFmpeg developers
  built with gcc 13 (Ubuntu 13.2.0-23ubuntu4)
  configuration: --enable-libsoxr --enable-libopus
  libavutil      58. 14.100 / 58. 14.100
  libavcodec     60. 22.100 / 60. 22.100
  libavformat    60. 10.100 / 60. 10.100
  libavdevice    60.  2.101 / 60.  2.101
  libavfilter     9.  8.102 /  9.  8.102
  libswscale      7.  3.100 /  7.  3.100
  libswresample   4. 11.100 /  4. 11.100
Input #0, matroska,webm, from 'SATTA.webm':
  Metadata:
    encoder         : google/video-file
  Duration: 00:03:10.02, start: -0.007000, bitrate: 124 kb/s
  Stream #0:0(eng): Audio: opus, 48000 Hz, stereo, fltp (default)
Stream mapping:
  Stream #0:0 -> #0:0 (opus (native) -> opus (libopus))
Press [q] to stop, [?] for help
[libopus @ 0x5e2b180430c0] No bit rate set. Defaulting to 96000 bps.
Output #0, opus, to '13 - SÁTTA.opus':
  Metadata:
    encoder         : Lavf60.10.100
  Stream #0:0(eng): Audio: opus, 48000 Hz, stereo, flt, 96 kb/s (default)
    Metadata:
      encoder         : Lavc60.22.100 libopus
[out#0/opus @ 0x5e2b18003d00] video:0kB audio:2065kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.713519%
size=    2080kB time=00:03:07.08 bitrate=  91.1kbits/s speed=26.6x    
Exiting normally, received signal 2.

I first encountered this issue on 6.1. By bisecting with 6.0 I came to the conclusion that it broke after commit a196d02e866909e0e632a3f4edfffa0eee82bc51. If I run this on master, it throws an assertion error Assertion best_input >= 0 failed at fftools/ffmpeg_filter.c:2075.