Building Dual-Domain Representations for Compression Artifacts Reduction

We propose a highly accurate approach to remove artifacts of JPEG-compressed images. Our approach jointly learns a very deep convolutional network in both DCT and pixel domains. The dual-domain representation can make full use of DCT-domain prior knowledge of JPEG compression, which is usually lacking in traditional network-based approaches. At the same time, it can also benefit from the prowess and the efficiency of the deep feed-forward architecture, in comparison to capacity-limited sparse-coding-based approaches. Two simple strategies, i.e., Adam and residual learning, are adopted to train the very deep network and later proved to be a success. Extensive experiments demonstrate the large improvements of our approach over the state of the arts.

[1]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Michael W. Marcellin,et al.  JPEG2000: standard for interactive imaging , 2002, Proc. IEEE.

[3]  Taejeong Kim,et al.  Regression-based prediction for blocking artifact reduction in JPEG-compressed images , 2005, IEEE Transactions on Image Processing.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[6]  Sorina Dumitrescu,et al.  ℓ2 Optimized Predictive Image Coding With ℓ∞ Bound , 2013, IEEE Trans. Image Process..

[7]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Jani Lainema,et al.  Adaptive deblocking filter , 2003, IEEE Trans. Circuits Syst. Video Technol..

[9]  Edward H. Adelson,et al.  Crisp Boundary Detection Using Pointwise Mutual Information , 2014, ECCV.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Sebastian Nowozin,et al.  Loss-Specific Training of Non-Parametric Image Restoration Models: A New State of the Art , 2012, ECCV.

[12]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Weisi Lin,et al.  Efficient Deblocking With Coefficient Regularization, Shape-Adaptive Filtering, and Quantization Constraint , 2008, IEEE Transactions on Multimedia.

[14]  Stefan Woltran,et al.  Generalizations of Dung Frameworks and Their Role in Formal Argumentation , 2014, IEEE Intelligent Systems.

[15]  Lei Zhang,et al.  l2 Restoration of l∞-Decoded Images Via Soft-Decision Estimation , 2012, IEEE Trans. Image Process..

[16]  Changhoon Yim,et al.  Quality Assessment of Deblocked Images , 2011, IEEE Transactions on Image Processing.

[17]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[18]  Xianming Liu,et al.  Data-driven sparsity-based restoration of JPEG-compressed images in dual transform-pixel domain , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Xianguo Zhang,et al.  The IEEE 1857 Standard: Empowering Smart Video Surveillance Systems , 2014, IEEE Intelligent Systems.

[20]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[21]  Wei Yu,et al.  On learning optimized reaction diffusion processes for effective image restoration , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[24]  C.-C. Jay Kuo,et al.  Review of Postprocessing Techniques for Compression Artifact Removal , 1998, J. Vis. Commun. Image Represent..

[25]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[27]  Avideh Zakhor Iterative procedures for reduction of blocking effects in transform image coding , 1992, IEEE Trans. Circuits Syst. Video Technol..

[28]  Xianming Liu,et al.  Inter-block consistent soft decoding of JPEG images with sparsity and graph-signal smoothness priors , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[29]  Xiaoou Tang,et al.  Compression Artifacts Reduction by a Deep Convolutional Network , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[30]  Luc Van Gool,et al.  Efficient regression priors for reducing image compression artifacts , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[31]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[32]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[33]  Makoto Takizawa,et al.  Future Data and Security Engineering , 2014, Lecture Notes in Computer Science.

[34]  Karen O. Egiazarian,et al.  Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images , 2007, IEEE Transactions on Image Processing.

[35]  Jae Lim,et al.  Reduction Of Blocking Effects In Image Coding , 1984 .

[36]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1992 .

[37]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Nikolas P. Galatsanos,et al.  Projection-based spatially adaptive reconstruction of block-transform compressed images , 1995, IEEE Trans. Image Process..

[39]  Tao Chen,et al.  Adaptive postfiltering of transform coefficients for the reduction of blocking artifacts , 2001, IEEE Trans. Circuits Syst. Video Technol..

[40]  Licheng Jiao,et al.  Image deblocking via sparse representation , 2012, Signal Process. Image Commun..