Visual structural degradation based reduced-reference image quality assessment

Reduced-reference (RR) image quality assessment (IQA) aims to use less reference data for quality evaluation. Global features are demanded to effectively express quality degradation caused by distortion. Since the human visual system (HVS) is highly sensitive to structure degradation, we suggest to represent the visual content of an image with several structural patterns. Also, image quality is measured based on the structural degradation on these patterns. Firstly, the spatial correlation of image structure is analyzed with the local binary pattern (LBP), and several representative structural patterns are extracted. Then, the energy changes on these patterns between the reference image and the distorted image are calculated. Finally, the support vector regression (SVR) procedure is adopted for feature pooling, and the quality score of the input image is returned. Experimental results for three publicly available databases demonstrate that the proposed RR IQA method is highly consistent with the human perception, which uses a small amount of reference data (20 values) and achieves a promising improvement on quality evaluation accuracy. HighlightsA novel structural pattern degradation based image quality assessment method is proposed.The structural pattern is created with both luminance change and spatial correlation.The content of an image is represented by several structural patterns.The quality is measured as the degradation on these structural patterns.

[1]  Nuno Vasconcelos,et al.  Natural Image Statistics and Low-Complexity Feature Selection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[3]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[4]  Fan Zhang,et al.  Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments , 2011, IEEE Transactions on Multimedia.

[5]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[7]  Xuelong Li,et al.  Image Quality Assessment Based on Multiscale Geometric Analysis , 2009, IEEE Transactions on Image Processing.

[8]  Karl J. Friston,et al.  Reinforcement Learning or Active Inference? , 2009, PloS one.

[9]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[10]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[11]  R. SheikhH.,et al.  No-reference quality assessment using natural scene statistics , 2005 .

[12]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[13]  Judith Redi,et al.  Color Distribution Information for the Reduced-Reference Assessment of Perceived Image Quality , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Zhou Wang,et al.  Reduced-reference image quality assessment using a wavelet-domain natural image statistic model , 2005, IS&T/SPIE Electronic Imaging.

[15]  Erkki Oja,et al.  Texture discrimination with multidimensional distributions of signed gray-level differences , 2001, Pattern Recognit..

[16]  Alan C. Bovik,et al.  RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment , 2012, IEEE Transactions on Image Processing.

[17]  David S. Doermann,et al.  No-Reference Image Quality Assessment Using Visual Codebooks , 2012, IEEE Transactions on Image Processing.

[18]  LinWeisi,et al.  Perceptual visual quality metrics , 2011 .

[19]  Mei Yu,et al.  Reduced-reference stereoscopic image quality assessment based on view and disparity zero-watermarks , 2014, Signal Process. Image Commun..

[20]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[21]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[22]  Yong Xu,et al.  Reduced reference image quality assessment using regularity of phase congruency , 2014, Signal Process. Image Commun..

[23]  Guangming Shi,et al.  Perceptual Quality Metric With Internal Generative Mechanism , 2013, IEEE Transactions on Image Processing.

[24]  Jeffrey Lubin,et al.  A VISUAL DISCRIMINATION MODEL FOR IMAGING SYSTEM DESIGN AND EVALUATION , 1995 .

[25]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[26]  Karl J. Friston.  The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[27]  Tubagus Maulana Kusuma,et al.  Reduced-reference metric design for objective perceptual quality assessment in wireless imaging , 2009, Signal Process. Image Commun..

[28]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[30]  Zhihua Xia,et al.  A Secure and Dynamic Multi-Keyword Ranked Search Scheme over Encrypted Cloud Data , 2016, IEEE Transactions on Parallel and Distributed Systems.

[31]  D. Ruderman.  The statistics of natural images , 1994 .

[32]  Guangming Shi,et al.  Just Noticeable Difference Estimation for Images With Free-Energy Principle , 2013, IEEE Transactions on Multimedia.

[33]  Guangming Shi,et al.  Reduced-Reference Image Quality Assessment With Visual Information Fidelity , 2013, IEEE Transactions on Multimedia.

[34]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[35]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[36]  Christian Olivier,et al.  Quaternionic wavelet coefficients modeling for a Reduced-Reference metric , 2015, Signal Process. Image Commun..

[37]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[38]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[39]  R. Quentin Grafton,et al.  Mean Squared Error , 2017, Encyclopedia of Machine Learning and Data Mining.

[40]  Fan Zhang,et al.  Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation , 2011, IEEE Transactions on Multimedia.

[41]  Bin Gu,et al.  Incremental Support Vector Learning for Ordinal Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Bin Gu,et al.  Incremental learning for ν-Support Vector Regression , 2015, Neural Networks.

[43]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[44]  Bin Gu,et al.  A Robust Regularization Path Algorithm for $\nu $ -Support Vector Classification , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[45]  Xiaojun Wu,et al.  Blind image quality assessment using a reciprocal singular value curve , 2014, Signal Process. Image Commun..

[46]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.