Quality comparison of the HEVC and VP9 encoders performance

This paper reports a comparison between two recent video codecs, namely the HEVC and the VP9, using High Definition Video Sequences encoded with different bit rates. A subjective test for the evaluation of the provided Quality of Experience is reported. The video sequences were shown to a panel of subjects on a High Definition LED display and the subjective tests were performed using a Single Stimulus Methodology. The results shown that the HEVC encoder provides a better visual quality on low bit rates than the VP9. Similar performance was obtained for visually lossless conditions, although the HEVC requires lower bit rates to reach that level. Moreover, the correlation of the subjective evaluation and three tested objective metrics (PSNR, SSIM, and FSIM) revealed a good representation of the subjective results, particularly the SSIM and the FSIM metrics.

[1]  Hari Kalva,et al.  Subjective evaluation of HEVC and AVC/H.264 in mobile environments , 2014, IEEE Transactions on Consumer Electronics.

[2]  Didier J. Le Gall,et al.  The MPEG video compression standard , 1991, Compcon.

[3]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[4]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[5]  Touradj Ebrahimi,et al.  Towards high efficiency video coding: Subjective evaluation of potential coding technologies , 2011, J. Vis. Commun. Image Represent..

[6]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Rajitha Weerakkody,et al.  Verification testing of HEVC compression performance for UHD video , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[8]  Sheila S. Hemami,et al.  Understanding and simplifying the structural similarity metric , 2008, 2008 15th IEEE International Conference on Image Processing.

[9]  Francesca De Simone,et al.  Subjective quality evaluation of the upcoming HEVC video compression standard , 2012, Other Conferences.

[10]  F. Massey The Kolmogorov-Smirnov Test for Goodness of Fit , 1951 .

[11]  Christiane,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2004, Journal international de bioethique = International journal of bioethics.

[12]  Philip H. Ramsey Nonparametric Statistical Methods , 1974, Technometrics.

[13]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[14]  Sarah Rothstein,et al.  Digital Video An Introduction To Mpeg 2 , 2016 .

[15]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Detlev Marpe,et al.  Performance comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC encoders , 2013, 2013 Picture Coding Symposium (PCS).

[17]  Arun N. Netravali,et al.  Digital Video: An introduction to MPEG-2 , 1996 .

[18]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[19]  Itu-T and Iso Iec Jtc Advanced video coding for generic audiovisual services , 2010 .

[20]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[21]  Itu-T Video coding for low bitrate communication , 1996 .

[22]  Masayuki Tanimoto,et al.  MPEG Video Compression Future , 2012 .

[23]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[24]  Debargha Mukherjee,et al.  Towards a next generation open-source video codec , 2013, Electronic Imaging.

[25]  Gary J. Sullivan,et al.  Video Compression - From Concepts to the H.264/AVC Standard , 2005, Proceedings of the IEEE.

[26]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[27]  Touradj Ebrahimi,et al.  Comparison of compression efficiency between HEVC/H.265 and VP9 based on subjective assessments , 2014, Optics & Photonics - Optical Engineering + Applications.