A new framework for multi-view image coding

We propose a new framework for the compression of multi-view image sequences. We define three types of frames, and each type is coded with a different strategy. The first type of frame is independently coded and is called I-frame. The second is a B-frame and is coded using a bidirectional disparity estimator and a modified version of the subspace projection technique (SPT). The SPT algorithm compensates the photometric variations between the multi-view frames. The projection block size is chosen to be small so that coding of the residual image is not necessary. On the other hand, to decrease the overhead information both disparity vectors and projection coefficients are coded with a lossy scheme. Finally, the third type of frame is a P-frame and is coded by employing a unidirectional disparity estimator and DC level compensation.

[1]  Wilson C. Chung,et al.  Image coding using high-order conditional entropy-constrained residual VQ , 1994, Proceedings of 1st International Conference on Image Processing.

[2]  Hiroyuki Yamaguchi,et al.  Stereoscopic images disparity for predictive coding , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[3]  Monson H. Hayes,et al.  Compression of multi-view images , 1994, Proceedings of 1st International Conference on Image Processing.

[4]  Takeshi Naemura,et al.  Self-similarity modeling for interpolation and extrapolation of multi-viewpoint image sets , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Liu Jin,et al.  Construction of intermediate pictures for a multiview 3D system , 1992, Electronic Imaging.

[6]  M. Lukacs,et al.  Predictive coding of multi-viewpoint image sets , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Toshiaki Fujii,et al.  3-D image coding based on affine transform , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Hiroshi Harashima,et al.  View interpolation using epipolar plane images , 1994, Proceedings of 1st International Conference on Image Processing.