Introduction

This page shows the results from the student projects that were part of GSoC 2024.

---

Projects

Enhancement of FFmpeg's libvmaf Filter ^{(Yigithan Yigit)}

My project was adding a public API to libmvaf(vmaf) to allow per-frame metadata propagation. This explanation might be little abstract let me explain;

Libvmaf can make feature extractions and fuse those extracted features to calculate/predict model feature(s) (vmaf itself is a predicted). You can see that extracted features by setting output file in vmaf cli or FFmpeg, but problem is you can only see that file when process is finished, in other words you can’t see extracted features while doing feature extraction or prediction.

My project was propagate those features to a user defined callback function when features are ready. In short I made program able to show extracted features when they extracted instead of waiting to process finish.

Implementing the eSSIM metric ^{(Andrea Mastroberti)}

The goal was to implement options for the vf_ssim.c filter in libavfilter such that it could compute eSSIM (enhanced SSIM). To do this, I've implemented options for integral images, resizable window size/stride for local statistics and pooling methods to aggregate said statistics (in particular, Minkowski pooling).

x86 assembly code for the VVC decoder ^{(Stone Chen)}

The goal was to implement x86 assembly code for the VVC decoder, focusing on two major functions: the DMVR SAD and Deblocking. Stone contributed by upstreaming the SAD function, achieving a performance boost of approximately 16-25x. The Deblocking function is nearly complete, with only the Luma long filter remaining. He will continue working on this until it is fully upstreamed, sharing much of the code with HEVC.