Opened 2 years ago

Last modified 2 years ago

#5690 new defect

Codec hevc_nvenc (GPU M4000) + HLS memory leak

Reported by: milanc Owned by:
Priority: normal Component: undetermined
Version: git-master Keywords: leak
Cc: Blocked By:
Blocking: Reproduced by developer: no
Analyzed by developer: no

Description

Summary of the bug:
driver: nvidia-358, CUDA 7.5, NVAPI 3.6

Hi, I have problem with hevc_nvenc encoding from DVB-S source into HLS.
More encoding instances (channels) means faster loss of memory.
For example 8xFullHD streams corresponds to loss 5MB/s of RAM.

I try to use valgrind and I see that some cuda 352 libraries are used.
The cuda7.5 package is depended on 352 driver (?) and I can't change it.

==5808== 341,531 bytes in 109 blocks are possibly lost in loss record 1,631 of 1,655
==5808==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==5808==    by 0x1DB5CF1D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.352.79)
==5808==    by 0x1DB0D34C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.352.79)
==5808==    by 0x1DB1E11F: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.352.79)
==5808==    by 0x1DB24D25: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.352.79)
==5808==    by 0x1DA9EC19: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.352.79)
==5808==    by 0x1DA9EECB: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.352.79)
==5808==    by 0x1DA82352: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.352.79)
==5808==    by 0x1DA50350: cuCtxCreate_v2 (in /usr/lib/x86_64-linux-gnu/libcuda.so.352.79)
==5808==    by 0x472136: ??? (in /usr/local/bin/ffmpeg)
==5808==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==5808==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==5808==
==5808== LEAK SUMMARY:
==5808==    definitely lost: 72 bytes in 1 blocks
==5808==    indirectly lost: 0 bytes in 0 blocks
==5808==      possibly lost: 999,476 bytes in 1,104 blocks
==5808==    still reachable: 1,883,507,503 bytes in 11,898 blocks
==5808==         suppressed: 0 bytes in 0 blocks
==5808== Reachable blocks (those to which a pointer was found) are not shown.
==5808== To see them, rerun with: --leak-check=full --show-leak-kinds=all
==5808==
==5808== For counts of detected and suppressed errors, rerun with: -v
==5808== Use --track-origins=yes to see where uninitialised values come from
==5808== ERROR SUMMARY: 557 errors from 172 contexts (suppressed: 0 from 0)
ffmpeg version N-80900-g77eb05a Copyright (c) 2000-2016 the FFmpeg developers
  built with gcc 4.8 (Ubuntu 4.8.4-2ubuntu1~14.04.3)
  configuration: --prefix=/FFMPEG --pkg-config-flags=--static --bindir=/root/bin --enable-gpl --enable-nonfree --enable-libfdk-aac --enable-libmp3lame --enable-libx264 --enable-libx265 --enable-nvenc --enable-libmfx --enable-version3 --enable-pthreads --enable-runtime-cpudetect --disable-ffserver --enable-libfreetype --enable-filter=drawtext
  libavutil      55. 28.100 / 55. 28.100
  libavcodec     57. 48.101 / 57. 48.101
  libavformat    57. 41.100 / 57. 41.100
  libavdevice    57.  0.102 / 57.  0.102
  libavfilter     6. 47.100 /  6. 47.100
  libswscale      4.  1.100 /  4.  1.100
  libswresample   2.  1.100 /  2.  1.100
  libpostproc    54.  0.100 / 54.  0.100
Hyper fast Audio and Video encoder

My command...

ffmpeg -i "udp://@SOURCE_IP?fifo_size=1000000&overrun_nonfatal=1" -flags -global_header -map v:0 -c:v hevc_nvenc -b:v 3000k -maxrate 4000k -bufsize 3000k -deinterlace -vf crop=in_w-0:in_h-0,scale=1920:1080,null -keyint_min 30 -g 100 -map a:0 -c:a libfdk_aac -b:a 128k -ar 44100 -ac 2 -hls_time 5 -hls_list_size 6 -hls_base_url http://A.B.C.D/101/ -hls_flags delete_segments -hls_segment_filename /hls/101/mystream-%08d.ts  /hls/101/mystream.m3u8

Change History (10)

comment:1 Changed 2 years ago by milanc

NVAPI 6.0

comment:2 Changed 2 years ago by oromit

Is this also happening with plain testsrc to /dev/null encoding?
Or just when using hls, without nvenc?
I highly doubt the nvenc encoder is leaking CUDA contexts, so the reported leaks are happening only exactly once and won't build up over time.

comment:3 Changed 2 years ago by milanc

Hi, I try "-f null -" output instead HLS.
And I have the same result, with one ffmpeg stream is loss about 1MB/s.

comment:4 Changed 2 years ago by cehoyos

  • Keywords leak added
  • Priority changed from important to normal

Do You think this is a regression?

comment:5 Changed 2 years ago by milanc

I'm not sure. I was doing next experiments...
Memory consumption grows constantly, it depends on number of ffmpeg. I see increasing demands on each ffmpeg instance in top/htop.
This behaviour is the same for nvenc_hevc and nvenc_h264 codec.

comment:6 Changed 2 years ago by milanc

I reinstall NVIDIA-358 drivers and CUDA... Now valgrind output seems better (no rows with 352-drivers/libs) but the problem remains. Can valgrind output help to find cause? Thank you.

==23839== Memcheck, a memory error detector
==23839== Copyright (C) 2002-2013, and GNU GPL'd, by Julian Seward et al.
==23839== Using Valgrind-3.10.1 and LibVEX; rerun with -h for copyright info
==23839== Command: ffmpeg -i ./test264.mp4 -c:v hevc_nvenc /test265.avi
==23839==
ffmpeg version N-80900-g77eb05a Copyright (c) 2000-2016 the FFmpeg developers
  built with gcc 4.8 (Ubuntu 4.8.4-2ubuntu1~14.04.3)
  configuration: --prefix=/FFMPEG --pkg-config-flags=--static --bindir=/root/bin --enable-gpl --enable-nonfree --enable-libfdk-aac --enable-libmp3lame --enable-libx264 --enable-libx265 --enable-nvenc --enable-libmfx --enable-version3 --enable-pthreads --enable-runtime-cpudetect --disable-ffserver --enable-libfreetype --enable-filter=drawtext
  libavutil      55. 28.100 / 55. 28.100
  libavcodec     57. 48.101 / 57. 48.101
  libavformat    57. 41.100 / 57. 41.100
  libavdevice    57.  0.102 / 57.  0.102
  libavfilter     6. 47.100 /  6. 47.100
  libswscale      4.  1.100 /  4.  1.100
  libswresample   2.  1.100 /  2.  1.100
  libpostproc    54.  0.100 / 54.  0.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from './test264.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isomavc1mp42
    creation_time   : 2009-11-05 09:45:47
  Duration: 00:03:26.11, start: 0.000000, bitrate: 548 kb/s
    Stream #0:0(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 115 kb/s (default)
    Metadata:
      creation_time   : 2009-11-05 09:45:47
      handler_name    : (C) 2007 Google Inc. v08.13.2007.
    Stream #0:1(und): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p, 480x186 [SAR 1:1 DAR 80:31], 429 kb/s, 29.97 fps, 29.97 tbr, 30k tbn, 59.94 tbc (default)
    Metadata:
      creation_time   : 2009-11-05 09:45:47
      handler_name    : (C) 2007 Google Inc. v08.13.2007.
File '/test265.avi' already exists. Overwrite ? [y/N] y
==23839== Warning: noted but unhandled ioctl 0x30000001 with no size/direction hints.
==23839==    This could cause spurious value errors to appear.
==23839==    See README_MISSING_SYSCALL_OR_IOCTL for guidance on writing a proper wrapper.
==23839== Warning: set address range perms: large range [0x1000000000, 0x1700000000) (noaccess)
==23839== Warning: set address range perms: large range [0x200000000, 0x500000000) (noaccess)
==23839== Warning: set address range perms: large range [0x500000000, 0x800000000) (noaccess)
==23839== Conditional jump or move depends on uninitialised value(s)
==23839==    at 0x1AE8AC52: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AE9C3C1: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AE9A55E: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AE8CE01: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AF07EC8: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AC548F8: ??? (in /usr/lib/nvidia-358/libnvidia-encode.so.358.16)
==23839==    by 0x1AC6474C: ??? (in /usr/lib/nvidia-358/libnvidia-encode.so.358.16)
==23839==    by 0x4706D9: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x472192: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== Conditional jump or move depends on uninitialised value(s)
==23839==    at 0x1AE8AC62: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AE9C3C1: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AE9A55E: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AE8CE01: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AF07EC8: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AC548F8: ??? (in /usr/lib/nvidia-358/libnvidia-encode.so.358.16)
==23839==    by 0x1AC6474C: ??? (in /usr/lib/nvidia-358/libnvidia-encode.so.358.16)
==23839==    by 0x4706D9: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x472192: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== Conditional jump or move depends on uninitialised value(s)
==23839==    at 0x1AE8AC72: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AE9C3C1: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AE9A55E: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AE8CE01: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AF07EC8: ??? (in /usr/lib/nvidia-358/libnvcuvid.so.358.16)
==23839==    by 0x1AC548F8: ??? (in /usr/lib/nvidia-358/libnvidia-encode.so.358.16)
==23839==    by 0x1AC6474C: ??? (in /usr/lib/nvidia-358/libnvidia-encode.so.358.16)
==23839==    by 0x4706D9: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x472192: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
[avi @ 0xbe0f8e0] Using AVStream.codec to pass codec parameters to muxers is deprecated, use AVStream.codecpar instead.
    Last message repeated 1 times
Output #0, avi, to '/test265.avi':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isomavc1mp42
    ISFT            : Lavf57.41.100
    Stream #0:0(und): Video: hevc (hevc_nvenc) (Main), yuv420p, 480x186 [SAR 1:1 DAR 80:31], q=-1--1, 2000 kb/s, 29.97 fps, 29.97 tbn, 29.97 tbc (default)
    Metadata:
      creation_time   : 2009-11-05 09:45:47
      handler_name    : (C) 2007 Google Inc. v08.13.2007.
      encoder         : Lavc57.48.101 hevc_nvenc
    Side data:
      cpb: bitrate max/min/avg: 0/0/2000000 buffer size: 4000000 vbv_delay: -1
    Stream #0:1(und): Audio: mp3 (libmp3lame) (U[0][0][0] / 0x0055), 44100 Hz, stereo, fltp (default)
    Metadata:
      creation_time   : 2009-11-05 09:45:47
      handler_name    : (C) 2007 Google Inc. v08.13.2007.
      encoder         : Lavc57.48.101 libmp3lame
Stream mapping:
  Stream #0:1 -> #0:0 (h264 (native) -> hevc (hevc_nvenc))
  Stream #0:0 -> #0:1 (aac (native) -> mp3 (libmp3lame))
Press [q] to stop, [?] for help
frame=  876 fps= 35 q=13.0 size=    3681kB time=00:00:29.51 bitrate=1021.6kbits/s speed=1.18x
frame= 1875 fps= 35 q=13.0 size=    9105kB time=00:01:02.74 bitrate=1188.8kbits/s speed=1.18x
frame= 6177 fps= 37 q=13.0 Lsize=   31151kB time=00:03:26.10 bitrate=1238.1kbits/s speed=1.22x
video:27587kB audio:3221kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 1.112757%
==23839==
==23839== HEAP SUMMARY:
==23839==     in use at exit: 169,637 bytes in 102 blocks
==23839==   total heap usage: 748,847 allocs, 748,745 frees, 216,160,008 bytes allocated
==23839==
==23839== 16 bytes in 1 blocks are still reachable in loss record 1 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EE9F12: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F9C9: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 16 bytes in 1 blocks are still reachable in loss record 2 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EEAC8D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2C8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FAF7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 16 bytes in 1 blocks are still reachable in loss record 3 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E509BF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2E8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FAF7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 16 bytes in 1 blocks are still reachable in loss record 4 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EEAC8D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2C8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FB7C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 16 bytes in 1 blocks are still reachable in loss record 5 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E509BF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2E8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FB7C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 32 bytes in 1 blocks are still reachable in loss record 6 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x4E3868F: _dlerror_run (dlerror.c:141)
==23839==    by 0x4E380C0: dlopen@@GLIBC_2.2.5 (dlopen.c:87)
==23839==    by 0xF809EA: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x439309: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x7110B7: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484DD7: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 32 bytes in 1 blocks are still reachable in loss record 7 of 92
==23839==    at 0x4C2CE8E: realloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E3A2B1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3AFBF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 32 bytes in 1 blocks are still reachable in loss record 8 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4E7B1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E8070D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B20D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 32 bytes in 1 blocks are still reachable in loss record 9 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4E7B1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E8072C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B20D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 32 bytes in 1 blocks are still reachable in loss record 10 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4E7B1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DA6F: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E05A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 32 bytes in 1 blocks are still reachable in loss record 11 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4E7B1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DA6F: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E0ED: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 32 bytes in 1 blocks are still reachable in loss record 12 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4E7B1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DA6F: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E213: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 32 bytes in 1 blocks are indirectly lost in loss record 13 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x1AC6F0FD: ???
==23839==    by 0x1AC6DD78: ???
==23839==    by 0x1AC6529A: ???
==23839==    by 0x1AC6F201: ???
==23839==    by 0x1AC52F4D: ???
==23839==    by 0x1AC4E967: ???
==23839==    by 0x40100CC: call_init.part.0 (dl-init.c:64)
==23839==    by 0x40101F2: call_init (dl-init.c:36)
==23839==    by 0x40101F2: _dl_init (dl-init.c:126)
==23839==    by 0x4014C2F: dl_open_worker (dl-open.c:577)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x401437A: _dl_open (dl-open.c:661)
==23839==
==23839== 36 bytes in 1 blocks are still reachable in loss record 14 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EE6EDB: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E61FC9: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8EBF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE9232: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E618C0: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B171: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 37 bytes in 1 blocks are still reachable in loss record 15 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x40090F3: local_strdup (dl-load.c:162)
==23839==    by 0x40090F3: _dl_map_object (dl-load.c:2509)
==23839==    by 0x4014A13: dl_open_worker (dl-open.c:235)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x401437A: _dl_open (dl-open.c:661)
==23839==    by 0x4E3802A: dlopen_doit (dlopen.c:66)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x4E3862C: _dlerror_run (dlerror.c:163)
==23839==    by 0x4E380C0: dlopen@@GLIBC_2.2.5 (dlopen.c:87)
==23839==    by 0x471CA5: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 37 bytes in 1 blocks are still reachable in loss record 16 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x400BD93: _dl_new_object (dl-object.c:165)
==23839==    by 0x4006753: _dl_map_object_from_fd (dl-load.c:1059)
==23839==    by 0x4008DCF: _dl_map_object (dl-load.c:2605)
==23839==    by 0x4014A13: dl_open_worker (dl-open.c:235)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x401437A: _dl_open (dl-open.c:661)
==23839==    by 0x4E3802A: dlopen_doit (dlopen.c:66)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x4E3862C: _dlerror_run (dlerror.c:163)
==23839==    by 0x4E380C0: dlopen@@GLIBC_2.2.5 (dlopen.c:87)
==23839==    by 0x471CA5: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 40 bytes in 1 blocks are still reachable in loss record 17 of 92
==23839==    at 0x4C2D110: memalign (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x4C2D227: posix_memalign (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0xF633E9: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAEDB51: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF5B46: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF5D83: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 40 bytes in 1 blocks are still reachable in loss record 18 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EEA98D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE891B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 40 bytes in 1 blocks are still reachable in loss record 19 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EEA98D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE894A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 40 bytes in 1 blocks are still reachable in loss record 20 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EEA98D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAE1B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2C8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FB7C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 40 bytes in 1 blocks are still reachable in loss record 21 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5FBB6: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 48 bytes in 1 blocks are still reachable in loss record 22 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E73861: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E509E4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2E8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FAF7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 48 bytes in 1 blocks are still reachable in loss record 23 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E73861: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E509E4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2E8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FB7C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 48 bytes in 1 blocks are indirectly lost in loss record 24 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x1AC6E408: ???
==23839==    by 0x1AC6529A: ???
==23839==    by 0x1AC6F201: ???
==23839==    by 0x1AC52F4D: ???
==23839==    by 0x1AC4E967: ???
==23839==    by 0x40100CC: call_init.part.0 (dl-init.c:64)
==23839==    by 0x40101F2: call_init (dl-init.c:36)
==23839==    by 0x40101F2: _dl_init (dl-init.c:126)
==23839==    by 0x4014C2F: dl_open_worker (dl-open.c:577)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x401437A: _dl_open (dl-open.c:661)
==23839==    by 0x4E3802A: dlopen_doit (dlopen.c:66)
==23839==
==23839== 56 bytes in 1 blocks are still reachable in loss record 25 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19D9D1D1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D9F0AB: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE939B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8B3C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE9232: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E618C0: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B171: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 56 bytes in 1 blocks are still reachable in loss record 26 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19D9D1D1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D9EBD8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D9EFBD: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE939B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8DA6: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE9232: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E618C0: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B171: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 64 bytes in 1 blocks are still reachable in loss record 27 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EEA91C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE891B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 64 bytes in 1 blocks are still reachable in loss record 28 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EEA91C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE894A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 64 bytes in 1 blocks are still reachable in loss record 29 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E52F88: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F8EA: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 64 bytes in 1 blocks are still reachable in loss record 30 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EEA91C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAE1B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2C8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FB7C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 72 bytes in 1 blocks are still reachable in loss record 31 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4EFD1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3AFD8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 72 bytes in 1 blocks are still reachable in loss record 32 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EECF26: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EECFD4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B125: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 72 bytes in 1 blocks are still reachable in loss record 33 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E62273: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8EBF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE9232: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E618C0: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B171: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 96 bytes in 1 blocks are still reachable in loss record 34 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5F272: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FAF7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 96 bytes in 1 blocks are still reachable in loss record 35 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5F272: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FB7C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 96 (16 direct, 80 indirect) bytes in 1 blocks are definitely lost in loss record 36 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x1AC6528F: ???
==23839==    by 0x1AC6F201: ???
==23839==    by 0x1AC52F4D: ???
==23839==    by 0x1AC4E967: ???
==23839==    by 0x40100CC: call_init.part.0 (dl-init.c:64)
==23839==    by 0x40101F2: call_init (dl-init.c:36)
==23839==    by 0x40101F2: _dl_init (dl-init.c:126)
==23839==    by 0x4014C2F: dl_open_worker (dl-open.c:577)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x401437A: _dl_open (dl-open.c:661)
==23839==    by 0x4E3802A: dlopen_doit (dlopen.c:66)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==
==23839== 120 bytes in 3 blocks are still reachable in loss record 37 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EEA98D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE5D57: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E167: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 38 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE852B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE891B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 39 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA22: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE891B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 40 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE852B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE894A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 41 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA22: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE894A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 42 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DA5D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E05A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 43 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DA5D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E0ED: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 44 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DA5D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E213: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 45 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E0C1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 46 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B258: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 47 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F94C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 48 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F96C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 49 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F98C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 128 bytes in 1 blocks are still reachable in loss record 50 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA22: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAE1B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2C8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FB7C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 136 bytes in 1 blocks are still reachable in loss record 51 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FCE7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA60: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE891B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 136 bytes in 1 blocks are still reachable in loss record 52 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FBA4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA60: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE891B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 136 bytes in 1 blocks are still reachable in loss record 53 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FCE7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA60: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE894A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 136 bytes in 1 blocks are still reachable in loss record 54 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FBA4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA60: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE894A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 136 bytes in 1 blocks are still reachable in loss record 55 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FCE7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA60: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE5D57: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E167: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 56 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5003C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE852B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE891B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 57 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5003C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE852B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE894A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 58 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5003C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA22: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8613: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE894A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DCDF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 59 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5003C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DA5D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E213: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 60 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5003C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B258: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 61 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5003C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F94C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 62 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5003C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F96C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 63 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5003C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F98C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 64 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5003C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA22: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAE1B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2C8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FB7C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 65 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FBA4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEA4E3: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEA9BF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAE1B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5F2C8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FB7C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19DC7366: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19DC7F0B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19DAB302: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 66 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FBA4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E4A6: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E60772: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E641F1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E64629: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E6CFE5: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E6D707: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E6DE61: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19DC73A5: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 67 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FBA4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E9B5: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E646EC: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E6CFE5: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E6D707: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E6DE61: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19DC73A5: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19DC7F0B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19DAB302: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 68 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FBA4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E4A6: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E60772: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E641F1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E64629: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7B783: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19DC76C0: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19DC7F0B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19DAB302: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==
==23839== 136 bytes in 1 blocks are possibly lost in loss record 69 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FBA4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEC203: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEC88F: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EECA94: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E5FDBF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E605C1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E641F1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E64629: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4CA1E: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==
==23839== 152 bytes in 1 blocks are still reachable in loss record 70 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4782A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B1DC: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 168 bytes in 1 blocks are still reachable in loss record 71 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x4011872: _dl_check_map_versions (dl-version.c:293)
==23839==    by 0x4014EAC: dl_open_worker (dl-open.c:278)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x401437A: _dl_open (dl-open.c:661)
==23839==    by 0x4E3802A: dlopen_doit (dlopen.c:66)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x4E3862C: _dlerror_run (dlerror.c:163)
==23839==    by 0x4E380C0: dlopen@@GLIBC_2.2.5 (dlopen.c:87)
==23839==    by 0x471CA5: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 192 bytes in 3 blocks are still reachable in loss record 72 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EEA91C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE5D57: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E167: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 220 bytes in 1 blocks are still reachable in loss record 73 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EE6E2E: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E61FC9: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8EBF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE9232: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E618C0: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B171: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 224 bytes in 1 blocks are still reachable in loss record 74 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E805B1: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B20D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 264 bytes in 1 blocks are still reachable in loss record 75 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EE89C9: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE9232: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E618C0: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B171: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 296 bytes in 1 blocks are still reachable in loss record 76 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E6184E: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B171: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 352 bytes in 1 blocks are still reachable in loss record 77 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4E7CC: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DA6F: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E05A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 352 bytes in 1 blocks are still reachable in loss record 78 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4E7CC: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DA6F: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E0ED: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 352 bytes in 1 blocks are still reachable in loss record 79 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4E7CC: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7DA6F: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E213: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 384 bytes in 3 blocks are still reachable in loss record 80 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4FFC2: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA22: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE5D57: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E167: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 408 bytes in 3 blocks are still reachable in loss record 81 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4F672: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4FBA4: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E50244: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA60: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE5D57: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E167: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 408 bytes in 3 blocks are possibly lost in loss record 82 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5003C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EEAA22: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE5D57: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E7E167: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 416 bytes in 1 blocks are still reachable in loss record 83 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19EE825B: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E61FAD: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8EBF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE9232: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E618C0: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B171: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 472 bytes in 1 blocks are still reachable in loss record 84 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x4014041: add_to_global (dl-open.c:106)
==23839==    by 0x40151C6: dl_open_worker (dl-open.c:264)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x401437A: _dl_open (dl-open.c:661)
==23839==    by 0x4E3802A: dlopen_doit (dlopen.c:66)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x4E3862C: _dlerror_run (dlerror.c:163)
==23839==    by 0x4E380C0: dlopen@@GLIBC_2.2.5 (dlopen.c:87)
==23839==    by 0x1AEF0DE2: ???
==23839==    by 0x1AEF0E71: ???
==23839==    by 0x1AF07E64: ???
==23839==
==23839== 512 bytes in 1 blocks are still reachable in loss record 85 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4E7CC: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E8072C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B20D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 616 bytes in 1 blocks are still reachable in loss record 86 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E5F865: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E485F7: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B280: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 1,024 bytes in 1 blocks are still reachable in loss record 87 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4E7CC: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E8070D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B20D: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 1,179 bytes in 1 blocks are still reachable in loss record 88 of 92
==23839==    at 0x4C2CC70: calloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x400BAF3: _dl_new_object (dl-object.c:75)
==23839==    by 0x4006753: _dl_map_object_from_fd (dl-load.c:1059)
==23839==    by 0x4008DCF: _dl_map_object (dl-load.c:2605)
==23839==    by 0x4014A13: dl_open_worker (dl-open.c:235)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x401437A: _dl_open (dl-open.c:661)
==23839==    by 0x4E3802A: dlopen_doit (dlopen.c:66)
==23839==    by 0x400FFC3: _dl_catch_error (dl-error.c:187)
==23839==    by 0x4E3862C: _dlerror_run (dlerror.c:163)
==23839==    by 0x4E380C0: dlopen@@GLIBC_2.2.5 (dlopen.c:87)
==23839==    by 0x471CA5: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 6,600 bytes in 1 blocks are still reachable in loss record 89 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E61EFE: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8EBF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE9232: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E618C0: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B171: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 7,688 bytes in 1 blocks are still reachable in loss record 90 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19DC549A: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E622C3: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE8EBF: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19EE9232: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E618C0: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B171: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==
==23839== 10,336 bytes in 1 blocks are still reachable in loss record 91 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E7DDAC: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3B21C: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== 131,072 bytes in 1 blocks are still reachable in loss record 92 of 92
==23839==    at 0x4C2AB80: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x4C2CF1F: realloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==23839==    by 0x19E4EEE9: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E4F009: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19E3AFD8: ??? (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x19D75A6C: cuInit (in /usr/lib/x86_64-linux-gnu/libcuda.so.358.16)
==23839==    by 0x471FE4: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0xAF686D: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x4A1562: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x484E60: ??? (in /usr/local/bin/ffmpeg)
==23839==    by 0x808CF44: (below main) (libc-start.c:287)
==23839==
==23839== LEAK SUMMARY:
==23839==    definitely lost: 16 bytes in 1 blocks
==23839==    indirectly lost: 80 bytes in 2 blocks
==23839==      possibly lost: 2,312 bytes in 17 blocks
==23839==    still reachable: 167,229 bytes in 82 blocks
==23839==         suppressed: 0 bytes in 0 blocks
==23839==
==23839== For counts of detected and suppressed errors, rerun with: -v
==23839== Use --track-origins=yes to see where uninitialised values come from
==23839== ERROR SUMMARY: 19 errors from 19 contexts (suppressed: 0 from 0)

comment:7 Changed 2 years ago by oromit

I left the following command running for an hour, using nvidia-drivers 367.27:

./ffmpeg -f lavfi -i "testsrc=size=1920x1080" -pix_fmt yuv420p -c:v h264_nvenc -b:v 3000k -maxrate 4000k -bufsize 3000k -f null -y /dev/null

Using ffmpeg built from 1ad4471526c70d073b19bd551dc4193457d1e610, there was no increase in memory usage over the whole time.

So this is either coming from some other component of ffmpeg you are using, or from your nvidia driver.

comment:8 Changed 2 years ago by milanc

I tried your sample in eight instances simultaneously with nvenc_h264 and next test with nvenc_hevc codec... and I didn't see any memory loss.
This means that the problem is with some subcomponents, or in their combination, ok? I will it test more.

comment:9 Changed 2 years ago by milanc

I tried your sample in eight instances simultaneously with nvenc_h264 and next test with nvenc_hevc codec... and I didn't see any memory loss.
This means that the problem is with some subcomponents, or in their combination, ok? I will it test more.

comment:10 Changed 2 years ago by milanc

Hi, I tested more and I have new experiences.

This problem is codec independent, I have the same issue with cpu encoding - libx264, libx265 etc.

I switched back from current N-80900-g77eb05a/N-80924-gb450b82 (same result) to older version N-80225-g1729387 and it seems OK - no larger memory decrease in time (nvenc_hevc codec, 24 pcs of 720x576 video streams).

I have a second machine with GTX 960 and N-80225-g1729387 (is working without problem), now I check latest ffmpeg version here.

Note: See TracTickets for help on using tickets.