Dilated Deep Residual Network for Post-processing in TPG Based Image Coding

Lossy image compression algorithms like JPEG usually introduce visually annoying artifacts on decoded images, such as blocking artifacts, blurring and ringing effects. The tiny portable graphics (TPG) based image/video compression technique is proposed to improve JPEG compression performance. However, the lossy compression artifacts cannot be fully removed, especially at low coding bit-rates. Recently, some shallow convolutional neural network (CNN) models have been proposed as post-processing techniques to reduce compression artifacts. Learning from the fact that deep CNNs have shown extraordinary ability in high-level vision problems, we propose to investigate how a deeper CNN can further enhance the quality of decoded images. Specifically, we adopt a network with 16 residual blocks. In order to increase the receptive field, we change the first convolution layer in the first five residual blocks to dilated convolution with size 2. The primary experimental results show that the proposed model can outperform existing CNN based post-processing methods.

[1]  Siyuan Liu,et al.  Unsupervised Image Super-Resolution Using Cycle-in-Cycle Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  Dong Liu,et al.  A Convolutional Neural Network Approach for Post-Processing in HEVC Intra Coding , 2016, MMM.

[3]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Hong Yan,et al.  Blocking artifacts suppression in block-coded images using overcomplete wavelet representation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Xiaoou Tang,et al.  Compression Artifacts Reduction by a Deep Convolutional Network , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Eirikur Agustsson,et al.  NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[10]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jun Zhou,et al.  Adaptive non-local means filtering for image deblocking , 2011, 2011 4th International Congress on Image and Signal Processing.

[12]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[13]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).