On the use of SSIM in HEVC

The Structural SIMilarity (SSIM) index has been attracting an increasing amount of attention recently in the video coding community as a perceptual criterion for testing and optimizing video codecs. Meanwhile, the arrival of the new MPEG-H/H.265 High Efficiency Video Coding (HEVC) standard creates new opportunities and challenges in perceptual video coding. In this paper, we first elaborate what are the attributes that make SSIM a good candidate for perception-based development of HEVC and future video coding standards for both testing and optimization purposes. We then address the computational issues in practical applications of SSIM in HEVC, in particular the trade-off between efficient computation and accurate estimation of SSIM when working with video codecs that have sophisticated block partitioning structures and aim for encoding videos with a wide range of spatial resolutions.

[1]  Alan C. Bovik,et al.  Fast structural similarity index algorithm , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Homer H. Chen,et al.  Perceptual Rate-Distortion Optimization Using Structural Similarity Index as Quality Metric , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Chun-Ling Yang,et al.  Improved best prediction mode(s) selection methods based on structural similarity in H.264 I-frame encoder , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[4]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[5]  Homer H. Chen,et al.  Perceptual-based coding mode decision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[6]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[7]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[8]  Wen Gao,et al.  SSIM-Motivated Rate-Distortion Optimization for Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Zhou Wang,et al.  On the Mathematical Properties of the Structural Similarity Index , 2012, IEEE Transactions on Image Processing.

[10]  Itu-T and Iso Iec Jtc.  Advanced video coding for generic audiovisual services , 2010 .

[11]  Babu Hemanth Kumar Aswathappa,et al.  Rate-distortion optimization using structural information in H.264 strictly Intra-frame encoder , 2010, 2010 42nd Southeastern Symposium on System Theory (SSST).

[12]  Wen Gao,et al.  Perceptual Video Coding Based on SSIM-Inspired Divisive Normalization , 2013, IEEE Transactions on Image Processing.

[13]  Homer H. Chen,et al.  A perceptual-based approach to bit allocation for H.264 encoder , 2010, Visual Communications and Image Processing.

[14]  Abdul Rehman,et al.  SSIM-Inspired Quality Assessment, Compression, and Processing for Visual Communications , 2013 .

[15]  Lai-Man Po,et al.  A Novel Motion Estimation Method Based on Structural Similarity for H.264 Inter Prediction , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[16]  Lai-Man Po,et al.  An SSIM-optimal H.264/AVC inter frame encoder , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[17]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[18]  Lai-Man Po,et al.  Improved Inter Prediction based on Structural Similarity in H.264 , 2007, 2007 IEEE International Conference on Signal Processing and Communications.

[19]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[20]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[21]  Abdul Rehman,et al.  SSIM-Inspired Perceptual Video Coding for HEVC , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[22]  Lai-Man Po,et al.  A New Rate-Distortion Optimization Using Structural Information in H.264 I-Frame Encoder , 2005, ACIVS.

[23]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[24]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[25]  Zhou Wang,et al.  FROM H . 264 TO HEVC : CODING GAIN PREDICTED BY OBJECTIVE VIDEO QUALITY ASSESSMENT MODELS , 2012 .

[26]  Homer H. Chen,et al.  Improving video coding quality by perceptual rate-distortion optimization , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[27]  Yongdong Zhang,et al.  High Efficiency Video Coding: High Efficiency Video Coding , 2014 .

[28]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.