Deep blind quality evaluator for multiply distorted images based on monogenic binary coding

Abstract Perceptual quality evaluation of multiply distorted images has become a very challenging research topic. In this paper, we present a novel and efficient deep blind quality evaluator for multiply distorted images based on monogenic binary coding (MBC). Local complementary structural information and a deep learning method are employed to blindly evaluate the quality of multiply distorted images. First, a monogenic signal representation is utilized to decompose a multiply distorted image into three complementary components: orientation, phase, and magnitude. The quality-predictive features are then determined from the complementary components. Finally, the features are mapped to the human quality score of the multiply distorted image based on the deep neural network. The results on two newly established multiply distorted image subjective databases confirm that our metric has a better prediction performance than existing state-of-the-art full-reference and classical blind metrics.

[1]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[3]  Weisi Lin,et al.  Quality assessment of retargeted images by salient region deformity analysis , 2017, J. Vis. Commun. Image Represent..

[4]  Wujie Zhou,et al.  Local gradient patterns (LGP): An effective local-statistical-feature extraction scheme for no-reference image quality assessment , 2017, Inf. Sci..

[5]  Ghassan Al-Regib,et al.  CSV: Image quality assessment based on color, structure, and visual system , 2016, Signal Process. Image Commun..

[6]  Ghassan Al-Regib,et al.  PerSIM: Multi-resolution image quality assessment in the perceptually uniform color domain , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[7]  Chunping Hou,et al.  Analysis of Structural Characteristics for Quality Assessment of Multiply Distorted Images , 2018, IEEE Transactions on Multimedia.

[8]  Ying Li,et al.  A weighted full-reference image quality assessment based on visual saliency , 2017, J. Vis. Commun. Image Represent..

[9]  Mei Yu,et al.  No-reference Stereoscopic Image Quality Assessment Using Binocular Self-similarity and Deep Neural Network , 2016, Signal Process. Image Commun..

[10]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[11]  Amy R. Reibman,et al.  Image quality assessment in first-person videos , 2018, J. Vis. Commun. Image Represent..

[12]  Saeed Mahmoudpour,et al.  Reduced-reference quality assessment of multiply-distorted images based on structural and uncertainty information degradation , 2018, J. Vis. Commun. Image Represent..

[13]  Navdeep Goel,et al.  Anisotropic blind image quality assessment: Survey and analysis with current methods , 2018, J. Vis. Commun. Image Represent..

[14]  Tara N. Sainath,et al.  FUNDAMENTAL TECHNOLOGIES IN MODERN SPEECH RECOGNITION Digital Object Identifier 10.1109/MSP.2012.2205597 , 2012 .

[15]  Mohamed-Chaker Larabi,et al.  Using distortion and asymmetry determination for blind stereoscopic image quality assessment strategy , 2017, J. Vis. Commun. Image Represent..

[16]  Damon M. Chandler,et al.  Opinion-Unaware Blind Quality Assessment of Multiply and Singly Distorted Images via Distortion Parameter Estimation , 2018, IEEE Transactions on Image Processing.

[17]  Ivan V. Bajic,et al.  Color Gaussian Jet Features For No-Reference Quality Assessment of Multiply-Distorted Images , 2016, IEEE Signal Processing Letters.

[18]  Runsheng Wang,et al.  Local multiple patterns based multiresolution gray-scale and rotation invariant texture classification , 2012, Inf. Sci..

[19]  Ke Gu,et al.  An efficient and effective blind camera image quality metric via modeling quaternion wavelet coefficients , 2017, J. Vis. Commun. Image Represent..

[20]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[21]  Mohamed A. Deriche,et al.  A critical survey of state-of-the-art image inpainting quality assessment metrics , 2017, J. Vis. Commun. Image Represent..

[22]  Ghassan Al-Regib,et al.  UNIQUE: Unsupervised Image Quality Estimation , 2016, IEEE Signal Processing Letters.

[23]  Shu-Tao Xia,et al.  Referenceless quality metric of multiply-distorted images based on structural degradation , 2018, Neurocomputing.

[24]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[25]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[26]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[27]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[28]  Wenjun Zhang,et al.  Hybrid No-Reference Quality Metric for Singly and Multiply Distorted Images , 2014, IEEE Transactions on Broadcasting.

[29]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[30]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[31]  Wenjun Zhang,et al.  FISBLIM: A FIve-Step BLInd Metric for quality assessment of multiply distorted images , 2013, SiPS 2013 Proceedings.

[32]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[33]  Mariusz Oszust,et al.  No-reference image quality assessment with local features and high-order derivatives , 2018, J. Vis. Commun. Image Represent..

[34]  Shiqi Wang,et al.  HDR video quality assessment: Perceptual evaluation of compressed HDR video , 2018, J. Vis. Commun. Image Represent..

[35]  Simon C. K. Shiu,et al.  Monogenic Binary Coding: An Efficient Local Feature Extraction Approach to Face Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[36]  Ghassan Al-Regib,et al.  Perceptual Image Quality Assessment through Spectral Analysis of Error Representations , 2019, Signal Process. Image Commun..

[37]  Weisi Lin,et al.  No-Reference Quality Assessment for Multiply-Distorted Images in Gradient Domain , 2016, IEEE Signal Processing Letters.

[38]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[39]  Michael Felsberg,et al.  The monogenic signal , 2001, IEEE Trans. Signal Process..

[40]  Zhiguo Jiang,et al.  No Reference Quality Assessment for Multiply-Distorted Images Based on an Improved Bag-of-Words Model , 2015, IEEE Signal Processing Letters.

[41]  Mislav Grgic,et al.  Blind image sharpness assessment based on local contrast map statistics , 2018, J. Vis. Commun. Image Represent..

[42]  Wujie Zhou,et al.  Local and Global Feature Learning for Blind Quality Evaluation of Screen Content and Natural Scene Images , 2018, IEEE Transactions on Image Processing.

[43]  Madhuri Khambete,et al.  No-reference perceived image quality measurement for multiple distortions , 2017, Multimedia Tools and Applications.

[44]  Alan C. Bovik,et al.  Objective quality assessment of multiply distorted images , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[45]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.