Fast Motion and Disparity Estimation With Adaptive Search Range Adjustment in Stereoscopic Video Coding

Stereoscopic video gives viewers more realistic vision than traditional 2D videos by transmitting two different views simultaneously. It doubles the required bandwidth in comparison with single view videos. Motion and disparity estimation therefore play a key role in reducing the bit rate of stereoscopic videos. However, it brings extremely huge computational complexity to an encoder which obstructs it from practical uses. In the past few years, some fast algorithms were proposed where most of them speed up the coding time based on an accurate estimation in one field (motion/disparity field), and then relieve the computational burden in the other field (disparity/motion field). Nevertheless, the complexities of both motion and disparity estimation cannot be fully reduced. In this paper, an iterative motion and disparity estimation algorithm is proposed. The proposed algorithm can determine motion vectors of the right view and disparity vectors of the current stereo pair in an iterative way. The gain of this iterative search is due to the use of a stereo-motion consistency constraint in which the motion and disparity vectors can be estimated by updating the local optimal vectors iteratively. An adaptive search range adjustment through the confidence measure of the constraint is then designed to further strengthen the reliability of each step for the iterative search. Experimental results show that the speed-up gain of the proposed algorithm is 18.76 ~ 229.19 times compared to the full search algorithm with a negligible quality drop.

[1]  An Ping,et al.  Stereo video coding based on frame estimation and interpolation , 2003 .

[2]  Georgios Tziritas,et al.  Joint disparity and motion field estimation in stereoscopic image sequences , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[3]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Gozde Bozdagi Akar,et al.  Evaluation of stereo video coding schemes for mobile devices , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[5]  Kwanghoon Sohn,et al.  A Stereoscopic Video Generation Method Using Stereoscopic Display Characterization and Motion Analysis , 2008, IEEE Transactions on Broadcasting.

[6]  Aljoscha Smolic,et al.  An overview of available and emerging 3D video formats and depth enhanced stereo as efficient generic solution , 2009, 2009 Picture Coding Symposium.

[7]  Yan Luo,et al.  Stereo video coding based on frame estimation and interpolation , 2003, IEEE Trans. Broadcast..

[8]  Aljoscha Smolic,et al.  Coding Algorithms for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Wenxian Yang,et al.  An MPEG-4-compatible stereoscopic/multiview video coding scheme , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  A. Tamtaoui,et al.  Coherent disparity and motion compensation in 3DTV image sequence coding schemes , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[11]  Béatrice Pesquet-Popescu,et al.  A variational framework for simultaneous motion and disparity estimation in a sequence of stereo images , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  M. G. Strintzis,et al.  Joint motion/disparity MAP estimation for stereo Image sequences , 1996 .

[13]  Liang-Gee Chen,et al.  Joint Prediction Algorithm and Architecture for Stereo Video Hybrid Coding Systems , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Neil A. Dodgson,et al.  Autostereoscopic 3D displays , 2005, Computer.

[15]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  Liang-Gee Chen,et al.  Efficient stereo video coding system for immersive teleconference with two-stage hybrid disparity estimation algorithm , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[17]  Yui-Lam Chan,et al.  Reliable block motion estimation through the confidence measure of error surface , 1999, Signal Process..

[18]  Antonio Ortega,et al.  Predictive fast motion/disparity search for multiview video coding , 2006, Electronic Imaging.

[19]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[20]  Liang-Gee Chen,et al.  Fast motion estimation with inter-view motion vector prediction for stereo and multiview video coding , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  Kwanghoon Sohn,et al.  MPEG-4 compatible stereoscopic sequence codec for stereo broadcasting , 2005, IEEE Transactions on Consumer Electronics.