Quality Enhancement of Compressed Video via CNNs

This work presents a compressed video enhancement algorithm based on convolutional neural networks (CNNs), which aims to establish an end-to-end mapping function between the compressed and the original video frames. Finally, the data is stored or transferred in the form of video plus network parameters. We can get a quality improved frame when taking the compressed frame as the input of CNN. Unlike some traditional filtering methods, our method can utilize more prior information, and thus can recover more details. Our algorithm relies on the training data, and independent of the compression method itself. In this work, we adopt H.264/AVC as a typical encoder to verify the effectiveness of our algorithm. Experimental results demonstrate that the proposed algorithm provides better reconstructed quality than that of classical approaches.

[1]  Jongho Kim,et al.  Compression artifacts removal by signal adaptive weighted sum technique , 2011, IEEE Transactions on Consumer Electronics.

[2]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yao Zhao,et al.  Image Set Compression Based on Undirected Weighted Graph , 2015, J. Inf. Hiding Multim. Signal Process..

[4]  Shen-Chuan Tai,et al.  Low complexity deblocking method for DCT coded video signals , 2006 .

[5]  Jani Lainema,et al.  Adaptive deblocking filter , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Mei-Juan Chen,et al.  High Performance Adaptive Deblocking Filter for H.264 , 2006, IEICE Trans. Inf. Syst..

[7]  Anand Paul High Performance Adaptive Deblocking Filter for H.264/AVC , 2013 .

[8]  Aggelos K. Katsaggelos,et al.  Image and video compression algorithms based on recovery techniques using mean field annealing , 1995, Proc. IEEE.

[9]  Licheng Jiao,et al.  Image deblocking via sparse representation , 2012, Signal Process. Image Commun..

[10]  Benjamin Schrauwen,et al.  Deep content-based music recommendation , 2013, NIPS.

[11]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[12]  Shu-Jhen Fan-Jiang,et al.  Self-learning-based post-processing for image/video deblocking via sparse representation , 2014, J. Vis. Commun. Image Represent..

[13]  Sang Uk Lee,et al.  On the POCS-based postprocessing technique to reduce the blocking artifacts in transform coded images , 1998, IEEE Trans. Circuits Syst. Video Technol..

[14]  Chia-Hung Yeh,et al.  Post-processing deblocking filter algorithm for various video decoders , 2012 .

[15]  H. Sebastian Seung,et al.  Natural Image Denoising with Convolutional Networks , 2008, NIPS.

[16]  John F. Roddick,et al.  No-reference Quality Metric of Blocking Artifacts Based on Orthogonal Moments , 2014, J. Inf. Hiding Multim. Signal Process..

[17]  Shen-Chuan Tai,et al.  Deblocking filter for low bit rate MPEG-4 video , 2005, IEEE Transactions on Circuits and Systems for Video Technology.