Image Quality Assessment Based on Quaternion Singular Value Decomposition

We propose an image quality assessment metric based on quaternion singular value decomposition that represents a color image as a quaternion matrix, separates image noise information using singular value decomposition and extracts features from both the whole image and its noise information. In the proposed method, the color image and its local variance are represented by using quaternion and then performing singular value decomposition. Later, 75% of singular values are taken as image noise information. We extract a luminance comparison, contrast comparison, structure comparison, phase congruency and gradient magnitude from whole color images and extract the peak signal-to-noise ratio from image noise information as features. Finally, these features are used as the input to a kernel extreme learning machine to predict the quality of the tested images. Extensive experiments performed on four benchmark image quality assessment databases demonstrate that the proposed metric achieves high consistency with the subjective evaluations and outperforms state-of-the-art image quality assessment metrics.

[1]  Weisi Lin,et al.  SVD-Based Quality Metric for Image and Video Using Machine Learning , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[3]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[4]  Xiaojun Wu,et al.  Blind image quality assessment using a reciprocal singular value curve , 2014, Signal Process. Image Commun..

[5]  Chih-Jen Lin,et al.  The analysis of decomposition methods for support vector machines , 2000, IEEE Trans. Neural Networks Learn. Syst..

[6]  Bo Yan,et al.  Naturalness-Aware Deep No-Reference Image Quality Assessment , 2019, IEEE Transactions on Multimedia.

[7]  Deshi Li,et al.  RVSIM: a feature similarity method for full-reference image quality assessment , 2018, EURASIP J. Image Video Process..

[8]  Fan Zhang,et al.  SPCM: Image quality assessment based on symmetry phase congruency , 2020, Appl. Soft Comput..

[9]  Xinbo Gao,et al.  A Visual Residual Perception Optimized Network for Blind Image Quality Assessment , 2019, IEEE Access.

[10]  Zhibing Wang,et al.  HVS-based structural similarity for image quality assessment , 2008, 2008 9th International Conference on Signal Processing.

[11]  Soo-Chang Pei,et al.  Quaternion matrix singular value decomposition and its applications for color image processing , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[12]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Fuzhen Zhang Quaternions and matrices of quaternions , 1997 .

[15]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[16]  Gary R. Weckman,et al.  Selective ensemble based on extreme learning machine and improved discrete artificial fish swarm algorithm for haze forecast , 2017, Applied Intelligence.

[17]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[18]  Sebastian Bosse,et al.  A Haar wavelet-based perceptual similarity index for image quality assessment , 2016, Signal Process. Image Commun..

[19]  Yong Ding,et al.  Full-reference image quality assessment using statistical local correlation , 2014 .

[20]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[21]  Guangtao Zhai,et al.  Perceptual image quality assessment: a survey , 2020, Science China Information Sciences.

[22]  Sanghoon Lee,et al.  Deep blind image quality assessment by employing FR-IQA , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[23]  Weisi Lin,et al.  Image Quality Assessment Based on Local Linear Information and Distortion-Specific Compensation , 2017, IEEE Trans. Image Process..

[24]  Leon Hirsch Handbook Of Computer Vision And Applications , 2016 .

[25]  Zhou Wang,et al.  Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Nicolas Le Bihan,et al.  Singular value decomposition of quaternion matrices: a new tool for vector-sensor signal processing , 2004, Signal Process..

[27]  Han Wang,et al.  Ensemble Based Extreme Learning Machine , 2010, IEEE Signal Processing Letters.

[28]  Fei Zhou,et al.  SPSIM: A Superpixel-Based Similarity Index for Full-Reference Image Quality Assessment , 2018, IEEE Transactions on Image Processing.

[29]  Peter Kovesi,et al.  Image Features from Phase Congruency , 1995 .

[30]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[31]  Yong Wang,et al.  Color Image Quality Assessment Based on Quaternion Singular Value Decomposition , 2008, 2008 Congress on Image and Signal Processing.

[32]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[33]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[34]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[35]  Wilson S. Geisler,et al.  Image quality assessment based on a degradation model , 2000, IEEE Trans. Image Process..

[36]  Wang Yong Image quality assessment based on local variance and structure similarity , 2008 .

[37]  Sebastian Bosse,et al.  Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment , 2016, IEEE Transactions on Image Processing.

[38]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[39]  Azadeh Mansouri,et al.  SSVD: Structural SVD-based image quality assessment , 2019, Signal Process. Image Commun..

[40]  Baojun Zhao,et al.  A Perceptual Image Quality Assessment Metric Using Singular Value Decomposition , 2015, Circuits Syst. Signal Process..

[41]  Munchurl Kim,et al.  A Novel Image Quality Assessment With Globally and Locally Consilient Visual Quality Perception , 2016, IEEE Transactions on Image Processing.

[42]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[43]  Guowei Yang,et al.  Denoising color images by reduced quaternion matrix singular value decomposition , 2015, Multidimens. Syst. Signal Process..