Multiviewpoint video coding with MPEG-2 compatibility

An efficient video coding scheme is presented as an extension of the MPEG-2 standard to accommodate the transmission of multiple viewpoint sequences on bandwidth-limited channels. With the goal of compression and speed, the proposed approach incorporates a variety of existing computer graphics tools and techniques. Construction of each viewpoint image is predicted using a combination of perspective projection of three-dimensional (3-D) models, texture mapping, and digital image warping. Immediate application of the coding specification is foreseeable in systems with hardware-based real-time rendering capabilities, thus providing fast and accurate constructions of multiple perspectives.

[1]  A. Murat Tekalp,et al.  3-D motion estimation and wireframe adaptation including photometric effects for model-based coding of facial image sequences , 1994, IEEE Trans. Circuits Syst. Video Technol..

[2]  George Wolberg,et al.  Digital image warping , 1990 .

[3]  共立出版株式会社.  コンピュータ・サイエンス : ACM computing surveys , 1978 .

[4]  B. Bhanu,et al.  Estimating 3D Egomotion from Perspective Image Sequence , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Martin A. Fischler,et al.  Computational Stereo , 1982, CSUR.

[6]  Yi-Tong Zhou,et al.  Multi-sensor image fusion , 1994, Proceedings of 1st International Conference on Image Processing.

[7]  Nikolaos Grammalidis,et al.  Disparity field and depth map coding for multiview image sequence compression , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[8]  Dimitris AnastassiouCenter.  PERCEPTUAL ADAPTIVE QUANTIZATION OF STEREOSCOPIC VIDEO CODING USING MPEG-2'S TEMPORAL SCALABILITY STRUCTURE , 1995 .

[9]  Chih Ping Yeh,et al.  Depth perception based on fusion of stereo images , 1992, Other Conferences.

[10]  Tihao Chiang,et al.  Stereoscopic Video Coding , 1996 .

[11]  Barry G. Haskell,et al.  Stereoscopic video compression using temporal scalability , 1995, Other Conferences.

[12]  Dimitris Anastassiou,et al.  A theoretical study on an accurate reconstruction of multiview images based on the Viterbi algorithm , 1995, Proceedings., International Conference on Image Processing.

[13]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[14]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[15]  Belle Tseng.  Compatible Video Coding of Stereoscopic Sequences using MPEG-2's Scalability and Interlaced Structur , 1994 .

[16]  Sunanda Mitra.  Vision models for 3D surfaces , 1992, Other Conferences.