| | 14 | |
| | 15 | '''Description:''' This project is aimed to remove rain/haze in images/videos. It can be used for image and video processing to make them clearer and it can be a preprocessing method for many computer vision systems.This project goal was to implement deep-learning-based derain filter and dehaze filter. |
| | 16 | |
| | 17 | '''Results:''' Contributions of the GSoC period include: |
| | 18 | * Support of multiple DNN operations in FFmpeg, such as various padding methods ([[https://git.ffmpeg.org/gitweb/ffmpeg.git/commit/e45e6005ce6adbb91bf0a0a7194a8575650f0e31 | commit]]), different kinds of activation functions ([[https://git.ffmpeg.org/gitweb/ffmpeg.git/commit/ecc096513c32119341a1240b67778f3e24b4293e | commit]]) and the support of dilated convolution ([[https://git.ffmpeg.org/gitweb/ffmpeg.git/commit/023ea5e360cb08d4f71991aca45a636df831b88d | commit]]). These operations are needed for the implementation of derain filter and are also common operations for neural networks. |
| | 19 | * Implementation of [[https://arxiv.org/abs/1807.05698 | RSECAN]] model for derain filter ([[https://git.ffmpeg.org/gitweb/ffmpeg.git/commit/78e1d7f42110aec8d4cd703a7939c64b5a191952 | commit]]. |
| | 20 | * Implementation of dehaze filter ([[https://git.ffmpeg.org/gitweb/ffmpeg.git/commit/f0c97d613ea764db8e78b9cc40ff1c821b140c79 | commit]]. |
| | 21 | * Improvements and fixes of derain and dehaze filter. Commits: [[https://git.ffmpeg.org/gitweb/ffmpeg.git/commit/75d99e9d8027c741ce9ea1847128040e56c485c5 | 1]], [[https://git.ffmpeg.org/gitweb/ffmpeg.git/commit/c87237d10511a28a3cfb7bb88ed2af1907dc8f66 | 2]], [[https://git.ffmpeg.org/gitweb/ffmpeg.git/commit/59da9dcd7ef6277e4e04998ced71b05a6083c635 | 3]]. |
| | 22 | * Scripts for model training, evaluation and generation for derain and dehaze filter are provided in the [[https://github.com/XueweiMeng/derain_filter | repository]]. |
| | 23 | |
| | 24 | '''Future work:''' Evaluate more models for derain and dehaze. If their performance is better, they will be added to the derain filter in FFmpeg. |
| | 25 | |
| | 26 | '''Mentor:''' Steven Liu (lq AT chinaffmpeg DOT org) |
| | 27 | |
| | 28 | '''Student:''' Xuewei Meng (xwmeng96 AT gmail DOT com) |
