No-reference image quality assessment using modified extreme learning machine classifier

In this paper, we present a machine learning approach to measure the visual quality of JPEG-coded images. The features for predicting the perceived image quality are extracted by considering key human visual sensitivity (HVS) factors such as edge amplitude, edge length, background activity and background luminance. Image quality assessment involves estimating the functional relationship between HVS features and subjective test scores. The quality of the compressed images are obtained without referring to their original images ('No Reference' metric). Here, the problem of quality estimation is transformed to a classification problem and solved using extreme learning machine (ELM) algorithm. In ELM, the input weights and the bias values are randomly chosen and the output weights are analytically calculated. The generalization performance of the ELM algorithm for classification problems with imbalance in the number of samples per quality class depends critically on the input weights and the bias values. Hence, we propose two schemes, namely the k-fold selection scheme (KS-ELM) and the real-coded genetic algorithm (RCGA-ELM) to select the input weights and the bias values such that the generalization performance of the classifier is a maximum. Results indicate that the proposed schemes significantly improve the performance of ELM classifier under imbalance condition for image quality assessment. The experimental results prove that the estimated visual quality of the proposed RCGA-ELM emulates the mean opinion score very well. The experimental results are compared with the existing JPEG no-reference image quality metric and full-reference structural similarity image quality metric.

[1]  Zhou Wang,et al.  Blind measurement of blocking artifacts in images , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[2]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[3]  Marc Gazalet,et al.  Univariant assessment of the quality of images , 2002, J. Electronic Imaging.

[4]  A. Kai Qin,et al.  Evolutionary extreme learning machine , 2005, Pattern Recognit..

[5]  Alan C. Bovik,et al.  Image quality assessment using natural scene statistics , 2004 .

[6]  Marco Gori,et al.  Robust combination of neural networks and hidden Markov models for speech recognition , 2003, IEEE Trans. Neural Networks.

[7]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  Yi Lin,et al.  Support Vector Machines for Classification in Nonstandard Situations , 2002, Machine Learning.

[10]  R. Penrose A Generalized inverse for matrices , 1955 .

[11]  Silke Dodel,et al.  Neural networks approach to clustering of activity in fMRI data , 2005, IEEE Transactions on Medical Imaging.

[12]  Jean-Bernard Martens,et al.  A single-ended blockiness measure for JPEG-coded images , 2002, Signal Process..

[13]  Fahmida N. Chowdhury,et al.  A survey of neural networks applications in automatic control , 2001, Proceedings of the 33rd Southeastern Symposium on System Theory (Cat. No.01EX460).

[14]  D Haussler,et al.  Knowledge-based analysis of microarray gene expression data by using support vector machines. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Yi Lu Murphey,et al.  Feature extraction for a multiple pattern classification neural network system , 2002, Object recognition supported by user interaction for service robots.

[16]  T. Vlachos,et al.  Detection of blocking artifacts in compressed video , 2000 .

[17]  Raúl Rojas,et al.  A Short Proof of the Posterior Probability Property of Classifier Neural Networks , 1996, Neural Computation.

[18]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[19]  Paolo Gastaldo,et al.  Neural networks for the no-reference assessment of perceived quality , 2005, J. Electronic Imaging.

[20]  Ingrid Heynderickx,et al.  Objective quality assessment of displayed images by using neural networks , 2005, Signal Process. Image Commun..

[21]  J. D. Schaffer,et al.  Combinations of genetic algorithms and neural networks: a survey of the state of the art , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[22]  Shan Suthaharan,et al.  A perceptually significant block-edge impairment metric for digital video coding , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[23]  Zhou Wang,et al.  Why is image quality assessment so difficult? , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[24]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[25]  H.R. Wu,et al.  A generalized block-edge impairment metric for video coding , 1997, IEEE Signal Processing Letters.

[26]  Michael Yuen,et al.  A survey of hybrid MC/DPCM/DCT video coding distortions , 1998, Signal Process..

[27]  L. Breiman Heuristics of instability and stabilization in model selection , 1996 .

[28]  Nick G. Kingsbury,et al.  A distortion measure for blocking artifacts in images based on human visual sensitivity , 1995, IEEE Trans. Image Process..

[29]  Zbigniew Michalewicz,et al.  Genetic Algorithms Plus Data Structures Equals Evolution Programs , 1994 .

[30]  Guang-Bin Huang,et al.  Learning capability and storage capacity of two-hidden-layer feedforward networks , 2003, IEEE Trans. Neural Networks.

[31]  Yongmin Kim,et al.  A de-blocking algorithm and a blockiness metric for highly compressed images , 2002, IEEE Trans. Circuits Syst. Video Technol..

[32]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (2nd, extended ed.) , 1994 .