A fast direction predictor of inter frame prediction for multi-view video coding

Multi-view applications provide viewers a whole new viewing experience, and multi-view video coding (MVC) plays a key role in distributing multi-view video contents through networks with limited bandwidth. However, the computational load of a MVC encoder is pretty heavy so that it is hard to be realized in real-time applications. One reason behind this is that a MVC encoder has to make a decision of prediction direction based on rate-distortion optimization from both motion compensation prediction (MCP) and disparity compensation prediction (DCP) for multiple views. Motivated by this, this paper presents a novel fast MVC algorithm where a fast decision strategy of prediction direction of MCP and DCP is designed. Blocks with slow motion (SMBs) of all pictures in the base view and anchor pictures in enhancement views are identified based on MVs from MCP without additional computations. Then, the identification of SMBs in non-anchor frames of an enhancement view will be inferred from the SMBs of base view or the other coded enhancement views. Finally, the fast algorithm is achieved by applying MCP to SMBs of non-anchor pictures in enhancement views within the same GGOP. Experimental results conducted by JMVM 6.0 show that the average time reduction is 20% while the bitrate increase and PSNR loss are less than 0.25% and 0.0045 dB, respectively.

[1]  Liang-Gee Chen,et al.  Fast motion estimation with inter-view motion vector prediction for stereo and multiview video coding , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  J. Li,et al.  Multiview Image Coding Based on Geometric Prediction , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Liang-Gee Chen,et al.  Joint Prediction Algorithm and Architecture for Stereo Video Hybrid Coding Systems , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Liang-Gee Chen,et al.  Computation-Free Motion Estimation with Inter-View Mode Decision for Multiview Video Coding , 2007, 2007 3DTV Conference.

[5]  Wen Gao,et al.  A Fast Inter Frame Prediction Algorithm for Multi-View Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[6]  J. Li,et al.  An Epipolar Geometry-Based Fast Disparity Estimation Algorithm for Multiview Image and Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Feng Pan,et al.  Efficient Compression of Multi-view Video Using Hierarchical B Pictures , 2008, 2008 International Conference on Multimedia and Ubiquitous Engineering (mue 2008).

[8]  Mei Yu,et al.  Fast Macroblock Selection Algorithm for Multiview Video Coding Based on Inter-view Global Disparity , 2008, 2008 Congress on Image and Signal Processing.

[9]  Borko Furht,et al.  Challenges and Opportunities in Video Coding for 3D TV , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[10]  Yo-Sung Ho,et al.  Overview of Multi-view Video Coding , 2007, 2007 14th International Workshop on Systems, Signals and Image Processing and 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services.

[11]  Xiaohui Wei,et al.  Lowering the Complexity of Multi-view Encoding through Dynamic Segmentation and Registration of Video Object , 2006, 2006 International Conference on Image Processing.

[12]  Kwanghoon Sohn,et al.  Fast Disparity and Motion Estimation for Multi-view Video Coding , 2007, IEEE Transactions on Consumer Electronics.

[13]  Liang-Gee Chen,et al.  Stereo video coding system with hybrid coding based on joint prediction scheme , 2005, 2005 IEEE International Symposium on Circuits and Systems.