A novel pooling strategy for Full Reference Image Quality Assessment based on harmonic means

The most perceptual Full Reference Image Quality Assessment metrics (FR-IQA) shared a common two-step model; local quality measurement, and pooling. In this letter, a novel pooling strategy based on harmonic mean is proposed to predict the final quality score in FR-IQA. In contrast to arithmetic mean, the harmonic mean tends to emphasize the contributions from the local severely distorted regions or pixels in the definition of assessment function using reciprocal transformation. It is derived from the observations that humans visual attention is mostly affected with the region having severely distorted points or regions. In addition, the relationship of subjective visual quality with the quality score against different levels of distortion in the images is described as a non-linear procedure by introducing another reciprocal transformation in harmonic mean. The proposed pooling strategy is applied to some popular FR-IQA metrics, including SSIM, GSSIM, and FSIM. The experimental results have demonstrated that the metrics with proposed pooling strategy have better performances compared to the standard versions, especially on the images with small but seriously distorted regions. The proposed pooling strategy is computationally very efficient since only one averaging operation and two reciprocal transformations are required.

[1]  Alan C. Bovik,et al.  Visual Importance Pooling for Image Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[2]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[3]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[4]  David Zhang,et al.  A comprehensive evaluation of full reference image quality assessment algorithms , 2012, 2012 19th IEEE International Conference on Image Processing.

[5]  Boban P. Bondzulic,et al.  Additive models and separable pooling, a new look at structural similarity , 2014, Signal Process..

[6]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[7]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[8]  Chaofeng Li,et al.  Content-partitioned structural similarity index for image quality assessment , 2010, Signal Process. Image Commun..

[9]  Patrick Le Callet,et al.  Does where you Gaze on an Image Affect your Perception of Quality? Applying Visual Attention to Image Quality Metric , 2007, 2007 IEEE International Conference on Image Processing.

[10]  Sheila S. Hemami,et al.  Understanding and simplifying the structural similarity metric , 2008, 2008 15th IEEE International Conference on Image Processing.

[11]  Zhou Wang,et al.  Spatial Pooling Strategies for Perceptual Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[12]  Chun-Ling Yang,et al.  Gradient-Based Structural Similarity for Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[13]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[14]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[15]  D. Chandler Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.