Efficient disparity vector coding for multiview sequences

Abstract A multiview sequence codec with view scalability was described in a previous paper. To enhance the performance of this codec, an efficient disparity vector coding method for multiview sequences is proposed herein. For higher coding efficiency, we encode the differential vectors acquired by subtracting the original vectors from the predicted ones. To enhance the performance of disparity vector coding, it is essential to predict the disparity vectors accurately. The prediction by this proposed method utilizes the correlation among the multiview images, while conventional methods exploit the correlation among the causal blocks. Experiments were performed for three different 5 view sequences. We were able to confirm that the proposed method predicts disparity vectors accurately by comparing the entropy and the mean absolute values for differential vectors with conventional methods. Its performance is superior to vector coding methods used in MPEG-4 which uses only a spatial correlation. The proposed method increases the coding efficiency by a factor of 30–45% while preserving image quality.

[1]  S. Pastoor,et al.  Subjective assessments of the resolution of viewing directions in a multi-viewpoint 3D TV system , 1989 .

[2]  Monson H. Hayes,et al.  Stereo image coding: a projection approach , 1998, IEEE Trans. Image Process..

[3]  Geoffrey Egnal,et al.  Detecting Binocular Half-Occlusions: Empirical Comparisons of Five Approaches , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Nikolaos Grammalidis,et al.  Object-based coding of stereo image sequences using joint 3-D motion/disparity compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[5]  Ebroul Izquierdo Stereo matching for enhanced telepresence in three-dimensional videocommunications , 1997, IEEE Trans. Circuits Syst. Video Technol..

[6]  Mi-Hyun Kim,et al.  Edge-preserving directional regularization technique for disparity estimation of stereoscopic images , 1999, IEEE Trans. Consumer Electron..

[7]  M. Ziegler Digital stereoscopic imaging and applications. A way towards new dimensions. The RACE II Project DISTIMA , 1992 .

[8]  Gan-Cheih Chang,et al.  Multi-view image compression and intermediate view synthesis for stereoscopic applications , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[9]  Wenxian Yang,et al.  A multiview sequence CODEC with view scalability , 2004, Signal Process. Image Commun..

[10]  Dimitrios Tzovaras,et al.  Detection of occlusion and visible background and foreground areas in stereo image pairs , 2002, 9th International Conference on Electronics, Circuits and Systems.

[11]  Kwanghoon Sohn,et al.  Efficient Stereoscopic Video Coding Using Joint Disparity-Motion Estimation , 2004 .

[12]  Amar Aggoun,et al.  Compression of 3D integral images using wavelet decomposition , 2003, Visual Communications and Image Processing.

[13]  A. Tamtaoui,et al.  Coherent disparity and motion compensation in 3DTV image sequence coding schemes , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[14]  Cedric Nishan Canagarajah,et al.  Efficient multiview image compression using quadtree disparity estimation , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[15]  Nikolaos Grammalidis,et al.  Sprite generation and coding in multiview image sequences , 2000, IEEE Trans. Circuits Syst. Video Technol..

[16]  Amitabha Das,et al.  Estimation of Occlusion and Dense Motion Fields in a Bidirectional Bayesian Framework , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jens-Rainer Ohm,et al.  Incomplete 3-D multiview representation of video objects , 1999, IEEE Trans. Circuits Syst. Video Technol..

[18]  Yongdong Zhang,et al.  An efficient hierarchical disparity estimation algorithm for stereoscopic video coding , 2000, IEEE APCCAS 2000. 2000 IEEE Asia-Pacific Conference on Circuits and Systems. Electronic Communication Systems. (Cat. No.00EX394).

[19]  E. Izquierdo,et al.  Systems for disparity-based multiple-view interpolation , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[20]  Nikolaos Grammalidis,et al.  Disparity and occlusion estimation in multiocular systems and their coding for the communication of multiview image sequences , 1998, IEEE Trans. Circuits Syst. Video Technol..

[21]  Lionel Oisel,et al.  One-dimensional dense disparity estimation for three-dimensional reconstruction , 2003, IEEE Trans. Image Process..