Version 8 (modified by atomnuker, 4 years ago) (diff)



FFmpeg is the universal multimedia toolkit: a complete, cross-platform solution to record, convert, filter, and stream audio and video. It is used by a number of media players (including VLC and MPlayer), video websites (including YouTube and Vimeo), web browsers (including Google Chrome/Chromium and Firefox), social media (including Facebook and Twitter) and countless other software projects in the multimedia field and beyond.

This is our ideas page for Google Summer of Code 2017. See the GSoC Timeline for important dates.

Information for Students

Getting Started

  1. Get to know FFmpeg. If you are a student interested in contributing to FFmpeg, it is recommended to start by subscribing to the ffmpeg-devel mailing-list, visiting our FreeNode IRC channels (#ffmpeg-devel and #ffmpeg although you will find most developers on the first one), and exploring both the codebase and the development workflow. Feel free to contact us if you have any questions. Also do not hesitate to answer questions from other students on our IRC channel if you know the answer to something.
  1. Find a project. Listed on this page are mentored and un-mentored projects. Mentored projects are well-defined and mentor(s) have already volunteered. Un-mentored projects are additional ideas you may want to consider, but you will have to contact us to find a mentor. You can also propose your own project, if you can think of one that better fits your interest and skill level. If a project description is unclear or you have any questions, please get in touch with its mentor and/or join our IRC channel at #ffmpeg-devel.
  1. Contact us. If you decide on a project, get in touch with the community and let us know. If you want to work on a qualification task, let the respective mentor know so we can avoid duplicated efforts.
  1. Apply. Students should apply by April 3 at the very latest. The "work" period begins on May 30 and ends in August. Take a look at GSoC timeline for additional information. Note, make sure you apply to Google before the 3rd even if you have not yet finished your qualification task. And please apply as soon as possible: Applications can be improved until the 3rd but not afterwards!

Note: A friendly reminder that while the application to GSoC is important for you and GSoC, FFmpeg mentors will not base their decision solely on the GSoC application. We will judge the applicant based on their abilities in coding, learning the tools, communication skills etc. So please do not worry about your application being perfect for us. Although it is very important to follow GSoC's application rules so they can pay you.

Qualification Tasks

In order to get accepted you normally have to complete a small qualification task. FFmpeg development can be quite challenging and the qualification task helps us figure out whether you are motivated enough and have the potential to deliver successfully.

The qualification tasks are usually shown in the project description. Contact the respective mentor(s) for assistance on getting a related qualification task or if you want to propose your own. You can also browse the FFmpeg Bug Tracker for qualification task ideas. In general qualification tasks should include submitting a patch to the ffmpeg-devel mailing list which passes review and is accepted into the FFmpeg codebase. It will be common for such patches to need multiple iterations of submissions and reviews, so don't wait too long with the first submission! Note, please avoid picking a qualification task which another student is already working on, each student should work on a different qualification task.

Contacting FFmpeg

If you have questions or comments feel free to contact us via our mailing list, IRC channel, or e-mail one of the FFmpeg GSoC admins:

  • Mailing-list: ffmpeg-devel
  • IRC: #ffmpeg-devel on Freenode
  • FFmpeg GSoC Admins: Michael Niedermayer (michaelni in #ffmpeg-devel on Freenode IRC,, Reynaldo Verdejo (reynaldo in #ffmpeg-devel on Freenode IRC, R Verdejo on g mail), Carl Eugen Hoyos (cehoyos in #ffmpeg-devel on Freenode IRC, cehoyos at ag dot or dot at)

You may also contact a mentor directly if you have questions specifically related to one of the projects listed on this page.

Mentored Projects

This section lists well-defined projects that have one or more available mentors. If you are new to FFmpeg, and have relatively little experience with multimedia, you should favor a mentored project rather than propose your own. Contact the respective mentor(s) to get more information about the project and the requested qualification task.

FFA1 Codec Research

Description: Following in the footsteps of the FFv1 codec for lossless video compression, which was recently standardized and still continue to have ongoing research, the FFmpeg project has begun research on a new lossless audio codec, built upon modern technologies, with the hopes that it will be the best in the field. Research around lossless audio coding seems to have stopped in the past 10 years except for minor one-man efforts and low-resource codecs. Since then, many new techniques which help in the overall field of compression have been discovered or improved sufficiently (adaptive entropy encoding, PVQ, frequency domain intra prediction, integer DCTs, etc.). Students working on this project will help in the implementation and testing of these technologies for use in the FFA1 audio codec.

Expected results: The FFA1 reference encoder to produce the same efficiency or greater than FLAC without having much in common, while still maintaining bit-perfect reproduction by the decoder.

Prerequisites: C coding skills, basic familiarity with git, solid understanding of lossless/lossy audio coding.

Qualification Task: TBA

Alternative Qualification Task: TBA

Mentor: Rostislav Pehlivanov (atomnuker in #ffmpeg-devel on Freenode IRC,

Backup mentor: TBA

FITS image decoder and encoder

Description: Flexible Image Transport System (FITS) is an open standard defining a digital file format useful for storage, transmission and processing of scientific and other images. FITS is the most commonly used digital file format in astronomy.

Expected results: Fully working decoder and encoder.

Prerequisites: C coding skills, basic familiarity with git.

Qualification Task: TBA

Alternative Qualification Task: TBA

Mentor: Paul B Mahol (durandal_1707 in #ffmpeg-devel on Freenode IRC,

Backup mentor: Rostislav Pehlivanov (atomnuker in #ffmpeg-devel on Freenode IRC,

VMAF video filter

Description: Video Multi-Method Assessment Fusion (VMAF) is an video quality metric developed ( by Netflix. The metric provides an indication of how closely a video represents a source/reference. This is semantically similar to PSNR/SSIM, but VMAF is supposed to more closely reflect human visual perception. FFmpeg currently has video filters that measure PSNR/SSIM of any input video file compared to a reference, but it currently has no support for VMAF. In this task, you will add support for VMAF to FFmpeg.

Expected results: Fully functional video filter that measures the VMAF of any input video compared to a reference, and that does not depend on Netflix' code. If there is time, you will also write x86 SIMD optimizations.

Prerequisites: C coding skills, basic familiarity with git.

Qualification Task: Create a vmaf video filter based on (and linking to) Netflix' codebase.

Mentor: Ronald S. Bultje (BBB in #ffmpeg-devel on Freenode IRC,

VP9 decoder improvements

Description: VP9 is a video codec developed by Google. It yields significantly better quality per bit compared to H.264, which is why many websites use VP9 (if the client supports it) to stream video. FFmpeg has a native VP9 decoder that is significantly faster than Google's reference implementation. In this task, you will make this decoder even better.

Expected results: Improve FFmpeg's VP9 native decoder by implementing one or more of the following subtasks:

  • AVX2 implementations for all 10/12bpc DSP functions
  • AVX2 implementation for 8bpc loopfilter function
  • native alpha support for VP8/9 decoders
  • tile threading support

Prerequisites: C coding skills, x86 assembly skills (or the will to learn), basic familiarity with git. The AVX2 tasks require access to a Haswell or better x86 machine.

Qualification Task: Finish one task from the list in expected results.

Mentor: Ronald S. Bultje (BBB in #ffmpeg-devel on Freenode IRC,

Backup mentor: Rostislav Pehlivanov (atomnuker in #ffmpeg-devel on Freenode IRC,

Your Own Project Idea

A student can propose a project. Ideas can also be found by browsing bugs and feature requests on our bug tracker. The work should last the majority of the GSoC internship duration, the task must be approved by the developers, and a mentor must be assigned.

Students can discuss an idea in the ffmpeg-devel mailing-list, the #ffmpeg-devel IRC channel, or contact the FFmpeg GSoC admins for more information.