Content-Aware Prediction Algorithm With Inter-View Mode Decision for Multiview Video Coding

3-D video will become one of the most significant video technologies in the next-generation television. Due to the ultra high data bandwidth requirement for 3-D video, effective compression technology becomes an essential part in the infrastructure. Thus multiview video coding (MVC) plays a critical role. However, MVC systems require much more memory bandwidth and computational complexity relative to mono-view video coding systems. Therefore, an efficient prediction scheme is necessary for encoding. In this paper, a new fast prediction algorithm, content-aware prediction algorithm (CAPA) with inter-view mode decision, is proposed. By utilizing disparity estimation (DE) to find corresponding blocks between different views, the coding information, such as rate-distortion cost, coding modes, and motion vectors, can be effectively shared and reused from the coded view channel. Therefore, the computation for motion estimation (ME) in most view channels can be greatly reduced. Experimental results show that compared with the full search block matching algorithm (FSBMA) applied to both ME and DE, the proposed algorithm saves 98.4-99.1% computational complexity of ME in most view channels with negligible quality loss of only 0.03-0.06 dB in PSNR.

[1]  Liang-Gee Chen,et al.  A 1.3TOPS H.264/AVC single-chip encoder for HDTV applications , 2005, ISSCC. 2005 IEEE International Digest of Technical Papers. Solid-State Circuits Conference, 2005..

[2]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[3]  Guido Heising Efficient and robust motion estimation in grid-based hybrid video coding schemes , 2002, Proceedings. International Conference on Image Processing.

[4]  W. Gao,et al.  Inter-View Direct Mode for Multiview Video Coding , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Masayuki Tanimoto Free Viewpoint Television (FTV) , 2007 .

[7]  Jens-Rainer Ohm,et al.  Incomplete 3-D multiview representation of video objects , 1999, IEEE Trans. Circuits Syst. Video Technol..

[8]  Nikolaos Grammalidis,et al.  Disparity and occlusion estimation in multiocular systems and their coding for the communication of multiview image sequences , 1998, IEEE Trans. Circuits Syst. Video Technol..

[9]  Liang-Gee Chen,et al.  Joint Prediction Algorithm and Architecture for Stereo Video Hybrid Coding Systems , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Mark A. Horowitz,et al.  Light field video camera , 2000, IS&T/SPIE Electronic Imaging.

[11]  Lai-Man Po,et al.  A new center-biased search algorithm for block motion estimation , 1995, Proceedings., International Conference on Image Processing.

[12]  Yun He,et al.  A novel multi-view video coding scheme based on H.264 , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[13]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block matching motion estimation , 1997, Proceedings of ICICS, 1997 International Conference on Information, Communications and Signal Processing. Theme: Trends in Information Systems Engineering and Wireless Multimedia Communications (Cat..

[14]  Peter Eisert,et al.  Free viewpoint video extraction, representation, coding, and rendering , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[15]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[16]  K. Muller,et al.  Incomplete 3-D multiview representation of video objects , 1999 .

[17]  D. Marpe,et al.  Video coding with H.264/AVC: tools, performance, and complexity , 2004, IEEE Circuits and Systems Magazine.

[18]  Antonio Ortega,et al.  Predictive fast motion/disparity search for multiview video coding , 2006, Electronic Imaging.

[19]  Oliver Schreer,et al.  Three-dimensional image processing in the future of immersive media , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  An Ping,et al.  Stereo video coding based on frame estimation and interpolation , 2003 .

[21]  Tsuhan Chen,et al.  A Self-Reconfigurable Camera Array , 2004, Rendering Techniques.

[22]  Aljoscha Smolic,et al.  Interactive 3-D Video Representation and Coding Technologies , 2005, Proceedings of the IEEE.

[23]  Yao Wang,et al.  Multiview video sequence analysis, compression, and virtual viewpoint synthesis , 2000, IEEE Trans. Circuits Syst. Video Technol..

[24]  Toshiaki Fujii,et al.  Free viewpoint TV system based on ray-space representation , 2002, SPIE ITCom.

[25]  Kai-Kuang Ma,et al.  Correction to "a new diamond search algorithm for fast block-matching motion estimation" , 2000, IEEE Trans. Image Process..