A harmonic means pooling strategy for structural similarity index measurement in image quality assessment

Structural similarity index measurement (SSIM) is one of the most well known method in full reference image quality assessment metrics (FR-IQA). In this paper, a novel pooling strategy based on harmonic mean is proposed to enhance the performance of SSIM. Instead of arithmetic mean, the proposed pooling by harmonic mean tends to emphasize the contributions from the local severely distorted regions or pixels in the definition of assessment function using reciprocal transformation. The proposed object function has higher correlation with human perception, which is mostly affected with the regions having severely distorted points or regions. In addition, salience information is introduced to the object function for a better consideration of subject visual attention. The proposed pooling strategy is applied to classical SSIM and its variants, GSSIM and FSIM. The experimental results have demonstrated that the FR-IQA metrics with proposed pooling strategy have better performances compared to the standard versions, especially on the images with small but seriously distorted regions.

[1]  Yang Hu,et al.  Machine Learning to Design Full-reference Image Quality Assessment Algorithm , 2013 .

[2]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[3]  Wen Gao,et al.  Visual attention based image quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[4]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[5]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[6]  Chaofeng Li,et al.  Content-partitioned structural similarity index for image quality assessment , 2010, Signal Process. Image Commun..

[7]  Gaurav Bhatnagar,et al.  SVD Filter Based Multiscale Approach for Image Quality Assessment , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[8]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[9]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[10]  D. Chandler.  Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[11]  Sheila S. Hemami,et al.  Understanding and simplifying the structural similarity metric , 2008, 2008 15th IEEE International Conference on Image Processing.

[12]  Chun-Ling Yang,et al.  Gradient-Based Structural Similarity for Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[13]  Li Chen,et al.  Nonlinear additive model based saliency map weighting strategy for image quality assessment , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[14]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[15]  Guangming Shi,et al.  Perceptual Quality Metric With Internal Generative Mechanism , 2013, IEEE Transactions on Image Processing.

[16]  Jieying Zhu,et al.  Image Quality Assessment by Visual Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[17]  Boban P. Bondzulic,et al.  Additive models and separable pooling, a new look at structural similarity , 2014, Signal Process..

[18]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[19]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[20]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[21]  Alan C. Bovik,et al.  Visual Importance Pooling for Image Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  David Zhang,et al.  A comprehensive evaluation of full reference image quality assessment algorithms , 2012, 2012 19th IEEE International Conference on Image Processing.

[24]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[25]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[26]  Arjan Durresi,et al.  A survey: Control plane scalability issues and approaches in Software-Defined Networking (SDN) , 2017, Comput. Networks.

[27]  Patrick Le Callet,et al.  Does where you Gaze on an Image Affect your Perception of Quality? Applying Visual Attention to Image Quality Metric , 2007, 2007 IEEE International Conference on Image Processing.