Changes between Initial Version and Version 1 of SponsoringPrograms/GSoC/2019


Ignore:
Timestamp:
Jan 16, 2019, 9:45:58 PM (20 months ago)
Author:
reynaldo
Comment:

Blind import from 2018 - Needs updating

Legend:

Unmodified
Added
Removed
Modified
  • SponsoringPrograms/GSoC/2019

    v1 v1  
     1[[PageOutline(1-3)]]
     2
     3
     4= Introduction =
     5
     6FFmpeg is the universal multimedia toolkit: a complete, cross-platform solution to record, convert, filter, and stream audio and video. It is used by a number of media players (including VLC and MPlayer), video websites (including !YouTube and Vimeo), web browsers (including Google !Chrome/Chromium and Firefox), social media (including Facebook and Twitter) and countless other software projects in the multimedia field and beyond.
     7
     8This is our ideas page for [https://summerofcode.withgoogle.com/ Google Summer of Code 2018]. See the [https://developers.google.com/open-source/gsoc/timeline GSoC Timeline] for important dates.
     9
     10At the end of the program you can find all the results on the [[2018/Results|results page]].
     11----
     12
     13= Information for Students =
     14
     15== Getting Started ==
     16
     171. '''Get to know FFmpeg.''' If you are a student interested in contributing to FFmpeg, it is recommended to start by subscribing to the [http://ffmpeg.org/mailman/listinfo/ffmpeg-devel ffmpeg-devel] mailing-list, visiting our !FreeNode IRC channels (''#ffmpeg-devel'' and ''#ffmpeg'' although you will find most developers on the first one), and exploring both the codebase and the development workflow. Feel free to [#ContactingFFmpeg contact us] if you have any questions. Also do not hesitate to answer questions from other students on our IRC channel if you know the answer to something.
     18
     192. '''Find a project.''' Listed on this page are mentored and un-mentored projects. Mentored projects are well-defined and mentor(s) have already volunteered. Un-mentored projects are additional ideas you may want to consider, but you will have to contact us to find a mentor. You can also propose your own project, if you can think of one that better fits your interest and skill level. If a project description is unclear or you have any questions, please get in touch with its mentor and/or join our IRC channel at ''#ffmpeg-devel''.
     20
     213. '''Contact us.''' If you decide on a project, get in touch with the community and let us know. If you want to work on a qualification task, let the respective mentor know so we can avoid duplicated efforts.
     22
     234. '''Apply.''' Students should apply by March 27th at the very latest. The "work" period begins on May 14th and ends in August. Take a look at [https://developers.google.com/open-source/gsoc/timeline GSoC timeline] for additional information. Note, make sure you apply to Google before the 27th even if you have not yet finished your qualification task. And please apply as soon as possible: Applications can be improved until the 27th but not afterwards!
     24
     25{{{
     26#!div style="border: 1pt dotted; margin: 1em; background-color: #fffff9;"
     27'''Note''': A friendly reminder that while the application to GSoC is important for you and GSoC, FFmpeg mentors will not base their decision solely on the GSoC application. We will judge the applicant based on their abilities in coding, learning the tools, communication skills etc. So please do not worry about your application being perfect for us. Although it is very important to follow GSoC's application rules so they can pay you.
     28}}}
     29
     30== Qualification Tasks ==
     31
     32In order to get accepted you normally have to complete a small qualification task. FFmpeg development can be quite challenging and the qualification task helps us figure out whether you are motivated enough and have the potential to deliver successfully.
     33
     34The qualification tasks are usually shown in the project description. Contact the respective mentor(s) for assistance on getting a related qualification task or if you want to propose your own. You can also browse the [https://trac.ffmpeg.org FFmpeg Bug Tracker] for qualification task ideas. In general qualification tasks should include submitting a patch to the [http://ffmpeg.org/mailman/listinfo/ffmpeg-devel ffmpeg-devel mailing list] which passes review and is accepted into the FFmpeg codebase. It will be common for such patches to need multiple iterations of submissions and reviews, so don't wait too long with the first submission! Note, please avoid picking a qualification task which another student is already working on, each student should work on a different qualification task.
     35
     36== Contacting FFmpeg ==
     37
     38If you have questions or comments feel free to contact us via our mailing list, IRC channel, or e-mail one of the FFmpeg GSoC admins:
     39
     40* '''Mailing-list:''' [http://ffmpeg.org/mailman/listinfo/ffmpeg-devel ffmpeg-devel]
     41* '''IRC:''' ''#ffmpeg-devel'' on [https://ffmpeg.org/contact.html#IRCChannels Freenode]
     42* '''FFmpeg GSoC Admins:''' Michael Niedermayer (''michaelni'' in #ffmpeg-devel on Freenode IRC, michaelni@gmx.at), Reynaldo Verdejo (''reynaldo'' in #ffmpeg-devel on Freenode IRC, R Verdejo on g mail), Carl Eugen Hoyos (''cehoyos'' in #ffmpeg-devel on Freenode IRC, ceffmpeg at gmail dot com), Thilo Borgmann (thilo.borgmann at mail dot de)
     43
     44
     45You may also contact a mentor directly if you have questions specifically related to one of the projects listed on this page.
     46
     47----
     48
     49= Mentored Projects =
     50
     51This section lists well-defined projects that have one or more available mentors. If you are new to FFmpeg, and have relatively little experience with multimedia, you should favor a mentored project rather than propose your own. Contact the respective mentor(s) to get more information about the project and the requested qualification task.
     52
     53== Cineform improvements ==
     54
     55'''Description:''' Improve Cineform decoder. The Cineform decoder was previously reverse engineered but now GoPro have open sourced Cineform so we can add missing features and make the existing decoder fast. https://github.com/gopro/cineform-sdk
     56
     57'''Expected results:''' Support reading as many features of the format as possible.
     58
     59'''Prerequisites:''' Good C coding skills, basic familiarity with git. Knowledge of assembly desirable but can be learnt.
     60
     61'''Qualification Task:''' Fix https://trac.ffmpeg.org/ticket/5522, https://trac.ffmpeg.org/ticket/6265 and https://trac.ffmpeg.org/ticket/6675
     62
     63'''Mentor:''' Kieran Kunhya (''kierank'' in #ffmpeg-devel on Freenode IRC)
     64
     65'''Backup Mentor:''' Rostislav Pehlivanov (atomnuker [at] gmail [dot] com)
     66
     67== DICOM support ==
     68
     69'''Description:''' FFmpeg currently does not support DICOM files although this is a widely used image format that is often passed to patients who have no access to DICOM equipment.
     70
     71'''Expected results:''' Support reading as many features of the format as possible.
     72
     73'''Prerequisites:''' Good C coding skills, basic familiarity with git
     74
     75'''Qualification Task:''' Write a simple demuxer for a format currently unsupported by FFmpeg. The following tickets contain possible tasks, not all of them are equally simple / difficult, some may turn out to be less useful: #5154, #4748, #4519, #3986 (this may be too difficult or impossible), #3720, #2956, #2662 and #2176. Not all possible features of a demuxer have to be implemented (the more the better) but at least auto-detection and video decoding (and remuxing) should be possible to implement for all of them.
     76
     77'''Mentor:''' Carl Eugen Hoyos (''cehoyos'' in #ffmpeg-devel on Freenode IRC, ceffmpeg at gmail dot com)
     78
     79'''Backup Mentor:''' Thilo Borgmann (thilo.borgmann AT mail de)
     80
     81== HEIF support ==
     82
     83'''Description:''' FFmpeg currently does not support reading HEIF/HEIC files although this is a format with increasing usage in mobile devices.
     84
     85'''Expected results:''' Support reading the sample files that are attached to ticket #6521.
     86
     87'''Prerequisites:''' Good C coding skills, basic familiarity with git
     88
     89'''Qualification Task:''' See the list of tickets for the DICOM project above.
     90
     91'''Mentor:''' Carl Eugen Hoyos (''cehoyos'' in #ffmpeg-devel on Freenode IRC, ceffmpeg at gmail dot com)
     92
     93'''Backup Mentor:'''
     94
     95== MPEG-4 ALS codec improvements ==
     96
     97'''Description:''' The implementation for MPEG-4 ALS is still missing some features and known bugs exist. This project aims to add missing features to the decoder and possibly the encoder as well as raising compatibility with the reference encoders.
     98
     99'''Expected results:''' Improve FFmpeg's ALS native decoder by implementing one or more of the following subtasks:
     100* Add RLS-LMS prediction to the decoder / encoder
     101* Add FATE regression tests for RLS-LMS if appropriate
     102* Add floating-point support to the encoder
     103* Validate comptibility with reference codecs RM22/RM23
     104* Fix system dependent bugs to make FATE "green"
     105* Optimize FATE test samples in size and test coverage
     106* Solve known bugs in the codec
     107
     108'''Prerequisites:''' C coding skills, basic familiarity with git.
     109
     110'''Qualification Task:''' Fix one of the known bugs of ALS listed in our [http://trac.ffmpeg.org/tags?wiki=on&ticket=on&q=als bugtracker].
     111
     112'''Mentor:''' Mohammad Umair (''omerjerk'' in #ffmpeg-devel on Freenode IRC, omerjerk@gmail.com)
     113
     114'''Backup mentor:''' Thilo Borgmann (thilo.borgmann AT mail de)
     115
     116
     117== Super Resolution filter ==
     118
     119'''Description:'''  Use machine learning super resolution techniques to implement an upscaling filter. The student must evaluate the best suited method based on state of the art methods
     120
     121'''Expected results:''' A working super resolution filter, which could be trained for specific content.
     122
     123'''Prerequisites:''' Good C coding skills, knowledge of machine learning and convolutional neural networks, basic familiarity with git, familiarity with one machine learning framework.
     124
     125'''Qualification Task:''' Implement a ffmpeg filter which performs the [https://arxiv.org/abs/1501.00092 SRCNN] 2x upscale, pre-trained weights will be provided.
     126
     127'''Wiki page:''' [[SponsoringPrograms/GSoC/2018/SR|Super Resolution]]
     128
     129'''Mentor:''' Pedro Souza (bygrandao [at] gmail [dot] com)
     130
     131'''Backup Mentor:''' Michael Niedermayer (michaelni@gmx.at)
     132
     133== 360° video filter ==
     134
     135'''Description:'''  Write filter which will be supporting all projections (equirectangular, cubemap, etc), as output and input, found on Internet.
     136
     137'''Expected results:''' A working, full featured 360° video transformation filter which will also allow to extract FoV and do roll/yaw/pitch.
     138
     139'''Prerequisites:''' Good C coding skills, basic familiarity with git.
     140
     141'''Qualification Task:'''  Find filter posted on FFmpeg development mailing list which deals with two kind of projections and extend it.
     142
     143'''Mentor:''' Paul B Mahol (onemda [at] gmail [dot] com)
     144
     145'''Backup Mentor:''' Thilo Borgmann (thilo.borgmann AT mail de)
     146
     147== Motion search on the GPU using Vulkan ==
     148
     149'''Description:'''  Write a filter which will perform block-matching on the GPU with variable block sizes and will report back the motion vectors. This is a very important and costly operation done in many applications, from framerate interpolation to encoding to deinterlacing. Will involve reading research papers.
     150
     151'''Expected results:''' A partially-working block-matching algorithm done using shaders via the Vulkan framework in FFmpeg.
     152
     153'''Prerequisites:''' Basic familiarity with git, good C coding skills, familiarity with GLSL and some basic knowledge of motion estimation
     154
     155'''Qualification Task:''' Write a filter of your choice (though ask if its okay first) using the Vulkan filtering infrastructure.
     156
     157'''Mentor:''' Rostislav Pehlivanov (atomnuker [at] gmail [dot] com)
     158
     159'''Backup Mentor:''' Thilo Borgmann (thilo.borgmann AT mail de)
     160
     161
     162== Video filtering with OpenCL ==
     163
     164'''Description:'''
     165Write video filters to perform useful common operations on the GPU.
     166
     167Currently FFmpeg has good support for offloading decoding and encoding from the CPU (with support for DXVA2, D3D11, VAAPI, VDPAU, V4L2-M2M, and then many manufacturer-specific APIs), but not such good support for doing anything else with that video without using the CPU.  There is interop support for mapping between APIs so that generic methods like OpenCL which can be run on any GPU can be used together with specific video APIs for decoding and encoding, but currently there are only a few operations which can actually use this so many use-cases require expensive additional steps to download frames from the GPU and then upload them again later after performing some processing on the CPU.  Therefore, we would like to add more OpenCL filter support to libavfilter so that more operations can be offloaded.
     168
     169In particular:
     170* Scaler, supporting a choice of scaling algorithms.
     171* Deinterlacer, probably based on an existing filter such as yadif or bwdif.
     172* Colour conversion, for both RGB and YUV, supporting different ranges and colour spaces.
     173* Any other video filters you would find useful!
     174
     175There are also some related tasks which may be helpful:
     176* Adding more interop modes if you have a device which isn't currently supported.
     177* Adding support for testing GPU filters.  Currently the regression test suite only runs in software, extending it to be able to test the functionality of GPU filters would allow better testing - this is especially helpful given the wide variety of different devices it can run on.
     178
     179'''Expected results:'''
     180More filters which can run on the GPU, increasing the scope of operations which can be offloaded to the GPU and the pipelines which can run on the GPU only.
     181
     182'''Prerequisites:'''
     183* C coding ability and familiarity with git.
     184* Some knowledge of GPU concepts and programming (need not be OpenCL, much is transferrable so easy to learn).
     185* OpenCL-compatible GPU - easiest with Intel or AMD devices running on Linux or Windows; likely possible with many others.  More than one from different manufacturers would be helpful for testing.  CPU implementations can also be tested, but should be avoided for the main implementation work because they have very different performance properties.
     186
     187'''Qualification task:'''
     188Implement a new video filter for libavfilter which uses OpenCL.  This can be a copy of any existing CPU-only filter or a new filter of your choice (it need not be efficient or do anything complex).
     189
     190'''Mentor:'''  Mark Thompson (''jkqxz'' in #ffmpeg-devel, <sw@jkqxz.net>)
     191
     192'''Backup mentor:'''  Rostislav Pehlivanov (atomnuker [at] gmail [dot] com)
     193
     194
     195== Replacement for ffserver ==
     196
     197'''Description:'''
     198The ffserver project has been unmaintained for a while and therefore has been removed. A rewrite which uses only the public API could provide better maintainability and would (at least for now) use recent APIs. Obviously the number of features would be limited at first. A possibility would be to fork [https://github.com/klaxa/mkvserver_mk2 mkvserver_mk2] and work from there. This far only http video-live-streaming in matroska is supported and no runtime configuration can be done.
     199
     200'''Expected results:'''
     201* Configuration file support
     202* DASH support
     203* HLS support
     204* RTP support
     205* ...
     206
     207'''Qualification task:'''
     208TBD
     209
     210'''Mentor:''' Rostislav Pehlivanov (atomnuker [at] gmail [dot] com)
     211
     212----
     213
     214= Unmentored Projects =
     215
     216This is a list of projects that students are encouraged to consider if a mentored project is unavailable or not within the students skill or interests. The student will have to find a mentor for the project. A student can also [#YourOwnProjectIdea propose their own project].
     217
     218== VC-1 interlaced ==
     219
     220'''Description:''' The FFmpeg VC-1 decoder has improved over the years, but many samples are still not decoded bit-exact and some real-world interlaced streams show artefacts. This task is difficult.
     221
     222'''Expected results:'''
     223* Implement missing parts of interlacing
     224* Make more reference samples bit-exact
     225
     226'''Prerequisites:''' C coding skills, basic familiarity with git, ability to read and understand the vc1 specification and align that knowledge with the existing code
     227
     228'''Qualification Task:''' Find a bug in the current decoder implementation and fix it.
     229
     230== JPEG 2000 ==
     231
     232'''Description:''' FFmpeg contains a native JPEG 2000 encoder and decoder. Both are missing many features, see also the FFmpeg bug tracker for some unsupported samples. This task is difficult
     233
     234'''Expected results:''' A jpeg 2000 decoder which can decode more samples and / or an encoder that achieves higher compression.
     235
     236'''Qualification Task:''' Fix an issue (for example from the bug tracker) to show that you are capable of improving the codec implementation.
     237
     238'''Prerequisites:''' C coding skills, basic familiarity with git, good knowledge of Jpeg-2000
     239
     240----
     241
     242== Your Own Project Idea ==
     243
     244A student can propose a project. Ideas can also be found by browsing bugs and feature requests on our bug tracker. The work should last the majority of the GSoC internship duration, the task must be approved by the developers, and a mentor must be assigned.
     245
     246Students can discuss an idea in the [https://ffmpeg.org/mailman/listinfo/ffmpeg-devel/ ffmpeg-devel] mailing-list, the #ffmpeg-devel IRC channel, or contact the FFmpeg GSoC admins for more information.