An adaptive reference frame re-ordering algorithm for H.264/AVC based multi-view video codec

This paper proposes an adaptive reference frame re-ordering for H.264/AVC based multi-view video codecs. The algorithm relies on statistical analysis of block matching among reference frames at low bitrate. The coded macroblocks are statistically analysed and the corresponding order for reference frames is then determined. The adaptive reference frame re-ordering algorithm is evaluated for two scenarios. In the first scenario, the multi-view videos are coded using a prediction structure with a number of reference frames. In the second scenario, a video sequence that contains several scene changes is coded. The proposed algorithm has been tested using two different prediction structures for both scenarios. The measurements were carried out on four standard multi-view datasets in addition to a sequence that contains several scenes changes. Results show that the application of the proposed reference frame re-ordering algorithm significantly saves up to 6.2% of the bitrate when coding a sequence with multiple scene changes and up to 0.2 dB when coding a sequence using multiple reference frames at low bitrate.

[1]  André Kaup,et al.  H.264/AVC-compatible coding of dynamic light fields using transposed picture ordering , 2005, 2005 13th European Signal Processing Conference.

[2]  洪承郁,et al.  Dynamic reference frame reordering for frame sequential stereoscopic video encoding , 2010 .

[3]  Gozde Bozdagi Akar,et al.  A Multi-View Video Codec Based on H.264 , 2006, 2006 International Conference on Image Processing.

[4]  Ying Chen,et al.  The Emerging MVC Standard for 3D Video Services , 2008, EURASIP J. Adv. Signal Process..

[5]  Kwanghoon Sohn,et al.  Early disparity estimation skipping for multi-view video coding , 2012, EURASIP Journal on Wireless Communications and Networking.

[6]  J. Brandt,et al.  Fast Frame-Based Scene Change Detection in the Compressed Domain for MPEG-4 Video , 2008, 2008 The Second International Conference on Next Generation Mobile Applications, Services, and Technologies.

[7]  N. Canagarajah,et al.  A Novel H.264/AVC Based Multi-View Video Coding Scheme , 2007, 2007 3DTV Conference.

[8]  Akbar Sheikh Akbari,et al.  H.264/AVC based multi-view video codec using the statistics of block matching , 2013, Proceedings ELMAR-2013.

[9]  Aljoscha Smolic,et al.  3D video and free viewpoint video - From capture to display , 2011, Pattern Recognit..

[10]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[11]  Masayuki Tanimoto,et al.  FTV: Free-viewpoint Television , 2006, Signal Process. Image Commun..

[12]  Gangyi Jiang,et al.  Efficient Multi-Reference Frame Selection Algorithm for Hierarchical B Pictures in Multiview Video Coding , 2011, IEEE Transactions on Broadcasting.