Image quality assessment using a neural network approach

In this paper, we propose a neural network approach to image quality assessment. In particular, the neural network measures the quality of an image by predicting the mean opinion score (MOS) of human observers, using a set of key features extracted from the original and test images. Experimental results, using 352 JPEG/JPEG2000 compressed images, show that the neural network outputs correlate highly with the MOS scores, and therefore, the neural network can easily serve as a correlate to subjective image quality assessment. Using 10-fold cross-validation, the predicted MOS values have a linear correlation coefficient of 0.9744, a Spearman ranked correlation of 0.9690, a mean absolute error of 3.75%, and an rms error of 4.77%. These results compare very favorably with the results obtained with other methods, such as the structural similarity index of Wang et al. [2004].

[1]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[2]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[3]  David A. Atchison,et al.  The eye and visual optical instruments: Image quality criteria , 1997 .

[4]  Harry L. Snyder,et al.  Image Quality: Measures and Visual Performance , 1985 .

[5]  C.-C. Jay Kuo,et al.  A Haar Wavelet Approach to Compressed Image Quality Measurement , 2000, J. Vis. Commun. Image Represent..

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Azeddine Beghdadi,et al.  A new image distortion measure based on wavelet decomposition , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[8]  Paolo Gastaldo,et al.  Objective quality assessment of MPEG-2 video streams by using CBP neural networks , 2002, IEEE Trans. Neural Networks.

[9]  Patrick C. Teo,et al.  A model of perceptual image fidelity , 1995, Proceedings., International Conference on Image Processing.

[10]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[11]  Ingrid Heynderickx,et al.  Image quality assessment by using neural networks , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[12]  Jesús Malo,et al.  Video quality measures based on the standard spatial observer , 2002, Proceedings. International Conference on Image Processing.

[13]  Jesús Malo,et al.  Subjective image fidelity metric based on bit allocation of the human visual system in the DCT domain , 1997, Image Vis. Comput..

[14]  James Hu,et al.  DVQ: A digital video quality metric based on human vision , 2001 .

[15]  A. Beghdadi Design of an image distortion measure using spatial/spatial-frequency analysis , 2004, First International Symposium on Control, Communications and Signal Processing, 2004..

[16]  Zhou Wang,et al.  Why is image quality assessment so difficult? , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.