Comparison of Compression Efficiency between HEVC/H.265, VP9 and AV1 based on Subjective Quality Assessments

The growing requirements for broadcasting and streaming of high quality video continue to trigger demands for codecs with higher compression efficiency. AV1 is the most recent open and royalty free video coding specification developed by Alliance for Open Media (AOMedia) with a declared ambition of becoming the most popular next generation video coding standard. Primary alternatives to AV1 are the VP9 and the HEVC/H.265 which are currently among the most popular and widespread video codecs used in applications. VP9 is also a royalty free and open specification similar to AV1, while HEVC/H.265 requires specific licensing terms for its use in commercial products and services. In this paper, we compare AV1 to VP9 and HEVC/H.265 from rate distortion point of view in a broadcasting use case scenario. Mutual comparison is performed by means of subjective evaluations carried out in a controlled environment using HD video content with typical bitrates ranging from low to high, corresponding to very low up to completely transparent quality. We then proceed with an in-depth analysis of advantages and drawbacks of each codec for specific types of content and compare the subjective comparisons and conclusions to those obtained by others in the state of the art as well to those measured by means of objective metrics such as PSNR.

[1]  Touradj Ebrahimi,et al.  Towards high efficiency video coding: Subjective evaluation of potential coding technologies , 2011, J. Vis. Commun. Image Represent..

[2]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[3]  Touradj Ebrahimi,et al.  Comparison of compression efficiency between HEVC/H.265 and VP9 based on subjective assessments , 2014, Optics & Photonics - Optical Engineering + Applications.

[4]  Touradj Ebrahimi,et al.  Calculation of average coding efficiency based on subjective quality scores , 2014, Journal of Visual Communication and Image Representation.

[5]  Debargha Mukherjee,et al.  The latest open-source video codec VP9 - An overview and preliminary results , 2013, 2013 Picture Coding Symposium (PCS).

[6]  Wei Zhang,et al.  The SJTU 4K video sequence dataset , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[7]  Touradj Ebrahimi,et al.  Quality evaluation of HEVC and VP9 video compression in real-time applications , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).

[8]  Francesca De Simone,et al.  Subjective quality evaluation of the upcoming HEVC video compression standard , 2012, Other Conferences.

[9]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[10]  Detlev Marpe,et al.  Performance comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC encoders , 2013, 2013 Picture Coding Symposium (PCS).

[11]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.