Just Noticeable Difference Level Prediction for Perceptual Image Compression

A perceptual image compression framework is proposed in this work, including an adaptive picture-level just noticeable difference (PJND) prediction model and a perceptual coding scheme. Specifically speaking, a convolutional neural network (CNN) model is designed with the existing subjective image database to predict the PJND label for a given image. Then, the support vector regression model is utilized to determine the number of PJND levels. After that, a just noticeable difference generation algorithm is developed to compute the corresponding quality factor for each PJND level. Moreover, an effective perceptual coding scheme is devised for perceptual image compression. Finally, the accuracy of the proposed PJND prediction model and the performance of the proposed perceptual coding scheme are evaluated. The experimental results show that the proposed CNN based PJND prediction model achieves good prediction accuracy and the proposed perceptual coding scheme produces state-of-the-art rate distortion performances.

[1]  Manoranjan Paul,et al.  Just Noticeable Difference for Images With Decomposition Model for Separating Edge and Textured Regions , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Fan Zhang,et al.  Practical Image Quality Metric Applied to Image Coding , 2011, IEEE Transactions on Multimedia.

[3]  Hongyi Liu,et al.  Perceptually Lossless Image Coding Based on Foveated JND , 2015, 2015 IEEE International Conference on Information Reuse and Integration.

[4]  C.-C. Jay Kuo,et al.  Statistical Study on Perceived JPEG Image Quality via MCL-JCI Dataset Construction and Analysis , 2016, IQSP.

[5]  Munchurl Kim,et al.  HEVC-Based Perceptually Adaptive Video Coding Using a DCT-Based Local Distortion Detection Probability Model , 2016, IEEE Transactions on Image Processing.

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Heidi A. Peterson,et al.  Luminance-model-based DCT quantization for color image compression , 1992, Electronic Imaging.

[8]  Guangming Shi,et al.  Just Noticeable Difference Estimation for Images With Free-Energy Principle , 2013, IEEE Transactions on Multimedia.

[9]  Nagato Narita,et al.  Method for the Subjective Assessment of the Quality of Television Pictures Recommended by CCIR Rec. 500-5. , 1993 .

[10]  Jie Fu,et al.  Screen content image quality assessment via convolutional neural network , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[11]  F. Ernawan,et al.  THE OPTIMAL QUANTIZATION MATRICES FOR JPEG IMAGE COMPRESSION FROM PSYCHOVISUAL THRESHOLD , 2014 .

[12]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Christine Guillemot,et al.  Perceptually-Friendly H.264/AVC Video Coding Based on Foveated Just-Noticeable-Distortion Model , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Lina J. Karam,et al.  Adaptive image coding with perceptual distortion control , 2002, IEEE Trans. Image Process..

[16]  Ping Wang,et al.  MCL-JCV: A JND-based H.264/AVC video quality assessment dataset , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[17]  C.-C. Jay Kuo,et al.  Experimental design and analysis of JND test on coded image/video , 2015, SPIE Optical Engineering + Applications.

[18]  Weisi Lin,et al.  Estimating Just-Noticeable Distortion for Video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Wenjun Zhang,et al.  Quality Assessment Considering Viewing Distance and Image Resolution , 2015, IEEE Transactions on Broadcasting.

[20]  King Ngi Ngan,et al.  Free-Energy Principle Inspired Video Quality Metric and Its Use in Video Coding , 2016, IEEE Transactions on Multimedia.

[21]  Wen Gao,et al.  SSIM-Motivated Rate-Distortion Optimization for Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Weisi Lin,et al.  Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile , 2005, IEEE Trans. Circuits Syst. Video Technol..

[23]  Munchurl Kim,et al.  Learning-Based Just-Noticeable-Quantization- Distortion Modeling for Perceptual Video Coding , 2018, IEEE Transactions on Image Processing.

[24]  Li Dong,et al.  Visual distortion gauge based on discrimination of noticeable contrast changes , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Weisi Lin,et al.  Image Quality Assessment Based on Local Linear Information and Distortion-Specific Compensation , 2017, IEEE Trans. Image Process..

[26]  Kuo-Cheng Liu,et al.  A Perceptually Tuned Watermarking Scheme for Color Images , 2010, IEEE Transactions on Image Processing.

[27]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[28]  Lei Zhang,et al.  Stereoscopic Perceptual Video Coding Based on Just-Noticeable-Distortion Profile , 2011, IEEE Transactions on Broadcasting.

[29]  Hongyi Liu,et al.  Exploiting perceptual redundancy in images , 2015, Electronic Imaging.

[30]  James Hu,et al.  DVQ: A digital video quality metric based on human vision , 2001 .

[31]  Weisi Lin,et al.  Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation , 2005, IEEE Transactions on Image Processing.

[32]  Jie Fu,et al.  Distortion recognition for image quality assessment with convolutional neural network , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[33]  Guangming Shi,et al.  Enhanced Just Noticeable Difference Model for Images With Pattern Complexity , 2017, IEEE Transactions on Image Processing.

[34]  Edward J. Delp,et al.  Perceptual watermarks for digital images and video , 1999, Electronic Imaging.

[35]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[37]  Touradj Ebrahimi,et al.  Christopoulos: Thc Jpeg2000 Still Image Coding System: an Overview the Jpeg2000 Still Image Coding System: an Overview , 2022 .

[38]  C.-C. Jay Kuo,et al.  A GMM-based stair quality model for human perceived JPEG images , 2015, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[39]  Wen Gao,et al.  Just-Noticeable Difference-Based Perceptual Optimization for JPEG Compression , 2017, IEEE Signal Processing Letters.

[40]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[41]  King Ngi Ngan,et al.  Spatio-Temporal Just Noticeable Distortion Profile for Grey Scale Image/Video in DCT Domain , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[43]  Florent Autrusseau,et al.  JND mask adaptation for wavelet domain watermarking , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[44]  Yutao Liu,et al.  Blind Image Quality Estimation via Distortion Aggravation , 2018, IEEE Transactions on Broadcasting.