Object-based coding of stereo image sequences using joint 3-D motion/disparity compensation

An object-based coding scheme is proposed for the coding of a stereoscopic image sequence using motion and disparity information. A hierarchical block-based motion estimation approach is used for initialization, while disparity estimation is performed using a pixel-based hierarchical dynamic programming algorithm. A split-and-merge segmentation procedure based on three-dimensional (3-D) motion modeling is then used to determine regions with similar motion parameters. The segmentation part of the algorithm is interleaved with the estimation part in order to optimize the coding performance of the procedure. Furthermore, a technique is examined for propagating the segmentation information with time. A 3-D motion-compensated prediction technique is used for both intensity and depth image sequence coding. Error images and depth maps are encoded using discrete cosine transform (DCT) and Huffman methods. Alternately, an efficient wireframe depth modeling technique may be used to convey depth information to the receiver. Motion and wireframe model parameters are then quantized and transmitted to the decoder along with the segmentation information. As a straightforward application, the use of the depth map information for the generation of intermediate views at the receiver is also discussed. The performance of the proposed compression methods is evaluated experimentally and is compared to other stereoscopic image sequence coding schemes.

[1]  Jörn Ostermann,et al.  Object-oriented analysis-synthesis coding of moving images , 1989, Signal Process. Image Commun..

[2]  Ahmed Tamtaoui,et al.  Constrained disparity and motion estimators for 3DTV image sequence coding , 1991, Signal Process. Image Commun..

[3]  Nikolaos Grammalidis,et al.  Stereo image sequence coding based on three-dimensional motion estimation and compensation , 1995, Signal Process. Image Commun..

[4]  Murat Kunt,et al.  Image sequence coding by split and merge , 1991, IEEE Trans. Commun..

[5]  Michael Hötter,et al.  Optimization and efficiency of an object-oriented analysis-synthesis coder , 1994, IEEE Trans. Circuits Syst. Video Technol..

[6]  M. Hotter,et al.  Optimization and efficiency of an object-oriented analysis-synthesis coder , 1994 .

[7]  Michael G. Strintzis,et al.  Evaluation of multiresolution block matching techniques for motion and disparity estimation , 1994, Signal Process. Image Commun..

[8]  M. Ziegler Digital stereoscopic imaging and applications. A way towards new dimensions. The RACE II Project DISTIMA , 1992 .

[9]  Jean-Luc Dugelay,et al.  MOTION AND DISPARITY ANALYSIS OF A STEREOSCOPIC SEQUENCE APPLICATION TO 3DTV CODING , 1992 .

[10]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Tim J. Dennis,et al.  Three-dimensional parameter estimation from stereo image sequences for model-based image coding , 1995, Signal Process. Image Commun..

[12]  Michael Hötter,et al.  Object-oriented analysis-synthesis coding based on moving two-dimensional objects , 1990, Signal Process. Image Commun..

[13]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  A. Murat Tekalp,et al.  3-D motion estimation and wireframe adaptation including photometric effects for model-based coding of facial image sequences , 1994, IEEE Trans. Circuits Syst. Video Technol..