The fast stereo sequence compression using edge-directional joint disparity-motion estimation

This paper presents an efficient joint disparity-motion estimation algorithm and fast estimation scheme for stereo sequence CODEC. In stereo sequences, frames from one camera view (usually the left) are defined as the base layer, and frames from the other one as the enhancement layer. The enhancement-from-base-layer prediction then turns out as a disparity-compensated prediction instead of a motion-compensated prediction. Although the disparity-compensated prediction fails, it is still possible to achieve compression by motion-compensated prediction with the same channel. At the same time, the base layer represents a monoscopic sequence. Joint disparity-motion estimation can increase coding efficiency and reduce complexity of stereo CODEC using relationship between disparity and motion fields. The disparity vectors are estimated by using the left and right motion vectors and the previous disparity vectors in each time frame. In order to obtain more accurate disparity vectors, we include spatial prediction process after joint estimation. From joint estimation and spatial prediction, we can obtain accurate disparity vectors and then increase coding efficiency. Moreover, we proposed fast motion estimation technique which utilizes correlation for motion vectors of neighboring blocks. We confirmed PSNR of the proposed method increases by 0.5~1.5dB compared to the conventional methods from simulation results. At the same time, the processing time is reduced by almost 1/10.

[1]  M.Ebroul Izquierdo Stereo image analysis for multi-viewpoint telepresence applications , 1998 .

[2]  Nikolaos Grammalidis,et al.  Object-based coding of stereo image sequences using joint 3-D motion/disparity compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[3]  Georgios Tziritas,et al.  Joint disparity and motion field estimation in stereoscopic image sequences , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[4]  Barry G. Haskell,et al.  Stereoscopic video compression using temporal scalability , 1995, Other Conferences.

[5]  M. G. Strintzis,et al.  Joint motion/disparity MAP estimation for stereo Image sequences , 1996 .

[6]  Michael G. Perkins,et al.  Data compression of stereopairs , 1992, IEEE Trans. Commun..

[7]  Amitabha Das,et al.  Estimation of Occlusion and Dense Motion Fields in a Bidirectional Bayesian Framework , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Kwanghoon Sohn,et al.  Efficient Stereoscopic Video Coding Using Joint Disparity-Motion Estimation , 2004 .

[9]  A. Tamtaoui,et al.  Coherent disparity and motion compensation in 3DTV image sequence coding schemes , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[10]  Nikolaos Grammalidis,et al.  Disparity and occlusion estimation in multiocular systems and their coding for the communication of multiview image sequences , 1998, IEEE Trans. Circuits Syst. Video Technol..

[11]  Ebroul Izquierdo Stereo matching for enhanced telepresence in three-dimensional videocommunications , 1997, IEEE Trans. Circuits Syst. Video Technol..

[12]  Mi-Hyun Kim,et al.  Edge-preserving directional regularization technique for disparity estimation of stereoscopic images , 1999, IEEE Trans. Consumer Electron..