Reference picture selection using checkerboard pattern for resilient video coding

The improved compression efficiency achieved by the High Efficiency Video Coding (HEVC) standard has the counter-effect of decreasing error resilience in transmission over error-prone channels. To increase the error resilience of HEVC streams, this paper proposes a checkerboard reference picture selection method in order to reduce the prediction mismatch at the decoder in case of frame losses. The proposed approach not only allows to reduce the error propagation at the decoder, but also enhances the quality of reconstructed frames by selectively constraining the choice of reference pictures used for temporal prediction. The underlying approach is to increase the amount of accurate temporal information at the decoder when transmission errors occur, to improve the video quality by using an efficient combination of diverse motion fields. The proposed method compensates for the small loss of coding efficiency at frame loss rates as low as 3%. For a single frame-loss event the proposed method can achieve up to 2 dB of gain in the affected frames and an average quality gain of 0.84 dB for different error prone conditions.

[1]  Athanasios Leontaris,et al.  Video compression for lossy packet networks with mode switching and a dual-frame buffer , 2004, IEEE Transactions on Image Processing.

[2]  Zhenyu Wu,et al.  An Error Concealment Scheme for Entire Frame Losses for H.264/AVC , 2006, 2006 IEEE Sarnoff Symposium.

[3]  James Nightingale,et al.  The impact of network impairment on quality of experience (QoE) in H.265/HEVC video streaming , 2014, IEEE Transactions on Consumer Electronics.

[4]  Ting-Lan Lin,et al.  Error concealment algorithm for HEVC coded video using block partition decisions , 2013, 2013 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2013).

[5]  Victor C. M. Leung,et al.  A study on the HEVC performance over lossy networks , 2012, 2012 19th IEEE International Conference on Electronics, Circuits, and Systems (ICECS 2012).

[6]  Pamela C. Cosman,et al.  Error concealment for dual frame video coding with uneven quality , 2005, Data Compression Conference.

[7]  Hua Yang,et al.  Optimizing Motion Compensated Prediction for Error Resilient Video Coding , 2010, IEEE Transactions on Image Processing.

[8]  Anthony Vetro,et al.  Error resilience video transcoding for wireless communications , 2005, IEEE Wireless Communications.

[9]  Pamela C. Cosman,et al.  Weighted boundary matching error concealment for HEVC using block partition decisions , 2014, 2014 48th Asilomar Conference on Signals, Systems and Computers.

[10]  Pamela C. Cosman,et al.  Motion Compensated Error Concealment for HEVC Based on Block-Merging and Residual Energy , 2013, 2013 20th International Packet Video Workshop.

[11]  Yui-Lam Chan,et al.  Compressed-Domain Techniques for Error-Resilient Video Transcoding Using RPS , 2009, IEEE Transactions on Image Processing.

[12]  Gwo-Long Li,et al.  Effective error concealment algorithm of whole frame loss for H.264 video coding standard by recursive motion vector refinement , 2010, IEEE Transactions on Consumer Electronics.

[13]  Huijuan Cui,et al.  Bi-directional entire frame recovery in MDC video streaming , 2005, IEEE International Symposium on Communications and Information Technology, 2005. ISCIT 2005..

[14]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Bo Yan,et al.  A Hybrid Frame Concealment Algorithm for H.264/AVC , 2010, IEEE Transactions on Image Processing.

[16]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.