MPEG-4 compatible stereoscopic sequence codec for stereo broadcasting

This paper presents an efficient joint disparity-motion estimation algorithm and a fast motion estimation algorithm in an MPEG-4 compatible stereoscopic sequence codec for 3D broadcasting. In stereoscopic sequence coding, the critical problems to be solved are double bandwidth and computational complexity. However, the previous trials to reduce coding bits have increased computational complexity. In this paper, we try to implement fast algorithms for stereoscopic sequences while maintaining high coding efficiency. Joint disparity-motion estimation can increase coding efficiency and reduce the computational complexity of the stereoscopic codec by using the relationship between the disparity and motion fields. The disparity vectors are estimated by using the left and right motion vectors and the previous disparity vectors in each time frame. In order to obtain more accurate disparity vectors, we employ the spatial prediction process after joint estimation. From joint estimation and spatial prediction, we can obtain the accurately predicted disparity vectors and then increase the coding efficiency from those predicted vectors. Moreover, we propose a fast motion estimation algorithm which utilizes correlation between the motion vectors of the neighboring blocks. We confirmed that the PSNR of the proposed method is 1.0-2.0 dB higher than ones of conventional methods. In addition, the processing time is reduced by almost 1/10.

[1]  Chung-Hyun Ahn,et al.  Experimental service of 3DTV broadcasting relay in Korea , 2002, SPIE ITCom.

[2]  Tihao Chiang,et al.  Scalable rate control for MPEG-4 video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[3]  Angel G. Jordan,et al.  Segmentation-based coding of stereoscopic image sequences , 1996, Electronic Imaging.

[4]  Eran A. Edirisinghe,et al.  An extended H.264 CODEC for stereoscopic video coding , 2005, IS&T/SPIE Electronic Imaging.

[5]  Barry G. Haskell,et al.  Basics of stereoscopic video, new compression results with MPEG-2 and a proposal for MPEG-4 , 1997, Signal Process. Image Commun..

[6]  Kwanghoon Sohn,et al.  The fast stereo sequence compression using edge-directional joint disparity-motion estimation , 2005, IS&T/SPIE Electronic Imaging.

[7]  Barry G. Haskell,et al.  Stereoscopic video compression using temporal scalability , 1995, Other Conferences.

[8]  Georgios Tziritas,et al.  Joint disparity and motion field estimation in stereoscopic image sequences , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[9]  Amitabha Das,et al.  Estimation of Occlusion and Dense Motion Fields in a Bidirectional Bayesian Framework , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  M. G. Strintzis,et al.  Joint motion/disparity MAP estimation for stereo Image sequences , 1996 .

[11]  Ebroul Izquierdo Stereo matching for enhanced telepresence in three-dimensional videocommunications , 1997, IEEE Trans. Circuits Syst. Video Technol..

[12]  J. N. Ellinas,et al.  Stereo video coding based on interpolated motion and disparity estimation , 2003, 3rd International Symposium on Image and Signal Processing and Analysis, 2003. ISPA 2003. Proceedings of the.

[13]  Tae-Sun Choi,et al.  Improved motion stereo matching based on a modified dynamic programming , 2001 .

[14]  Michael G. Perkins,et al.  Data compression of stereopairs , 1992, IEEE Trans. Commun..

[15]  Kwanghoon Sohn,et al.  Efficient Stereoscopic Video Coding Using Joint Disparity-Motion Estimation , 2004 .

[16]  A. Tamtaoui,et al.  Coherent disparity and motion compensation in 3DTV image sequence coding schemes , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[17]  Nikolaos Grammalidis,et al.  Object-based coding of stereo image sequences using joint 3-D motion/disparity compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[18]  Changseob Park,et al.  New version of HD stereoscopic camera and its picture quality assessment concerning the camera parameters , 2005, IS&T/SPIE Electronic Imaging.

[19]  Chulhee Lee,et al.  Motion/Disparity Compensated Multiview Sequence Coding , 2004 .