Perceptual image quality assessment using block-based multi-metric fusion (BMMF)

A new block-based multi-metric fusion (BMMF) approach is proposed for perceptual image quality assessment. The proposed BMMF scheme automatically detects image content and distortion types in a block via machine learning, which is motivated by the observation that the performance of an image quality metric is highly influenced by these factors. Locally, image block content is classified into three types; namely, smooth, edge and texture. Image distortion is detected and grouped into five types. An appropriate image quality metric is adopted for each block by considering its content and distortion types, and then all block-based quality metrics are fused to result in one final score. Furthermore, a corrected version of BMMF is derived for a specific group of distortions based on image complexity analysis. The proposed BMMF scheme is tested on TID database with its Spearman Correlation equal to 0.9471, which outperforms today's state-of-the-art image quality metrics.

[1]  Nikolay N. Ponomarenko,et al.  METRICS PERFORMANCE COMPARISON FOR COLOR IMAGE DATABASE , 2008 .

[2]  J. Astola,et al.  ON BETWEEN-COEFFICIENT CONTRAST MASKING OF DCT BASIS FUNCTIONS , 2007 .

[3]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[4]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[5]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[7]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[8]  Marco Carli,et al.  Modified image visual quality metrics for contrast change and mean shift accounting , 2011, 2011 11th International Conference The Experience of Designing and Application of CAD Systems in Microelectronics (CADSM).

[9]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[10]  Weisi Lin,et al.  A multi-metric fusion approach to visual quality assessment , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[11]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[12]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[13]  Karen Egiazarian,et al.  Novel image quality metric based on similarity , 2011, ISSCS 2011 - International Symposium on Signals, Circuits and Systems.

[14]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[15]  Nikolay N. Ponomarenko,et al.  A NEW FULL-REFERENCE QUALITY METRICS BASED ON HVS , 2006 .

[16]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.