Distributed residual coding for multi-view video with joint motion vector projection and 3-D warping

Conventional multi-view video coding (MVC) requires high encoding complexity and high rate data transmission from cameras to a joint encoder. Distributed coding theories guarantee that low complexity and independent encoders can achieve similar coding efficiency as traditional methods. However, there is still a big performance gap between current distributed multi-view video coding (DMVC) schemes and conventional schemes. In this paper, we propose a novel distributed residual coding framework for multi-view video with joint motion vector projection (MVP) and 3-D warping. At the encoder, by means of the improved block classification, distributed residual coding is performed effectively to help reduce temporal redundancy. At the decoder, a joint motion vector projection and 3-D warping method is proposed to generate the candidates of side information and two binary fusion masks. Finally, we employ a novel fusion criterion with relation to the reliability of side information acquisition measures. Experimental results show that the proposed DMVC framework has achieved both side information quality and rate distortion performance improvement.

[1]  William R. Mark,et al.  Post-Rendering 3D Image Warping: Visibility, Reconstruction, and Performance for Depth-Image Warping , 1999 .

[2]  Qiwei Liu,et al.  Distributed multiview video coding using the fusion of triple side information , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[3]  Qiwei Liu,et al.  A Transform Domain Classification Based Wyner-Ziv Video Codec , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[4]  Wen Gao,et al.  Distributed multi-view video coding , 2006, Electronic Imaging.

[5]  David R. Bull,et al.  Fusion Methods for Side Information Generation in Multi-View Distributed Video Coding Systems , 2007, 2007 IEEE International Conference on Image Processing.

[6]  Zhihai He,et al.  Graph Matching Based Side Information Generation for Distributed Multi-View Video Coding , 2009, 2009 IEEE International Conference on Communications.