Compression and representation of 3-D images

This paper surveys the results of various studies on 3-D image coding. Themes are focused on efficient compression and display-independent representation of 3-D images. Most of the works on 3-D image coding have been concentrated on the compression methods tuned for each of the 3-D image formats (stereo pairs, multi-view images, volumetric images, holograms and so on). For the compression of stereo images, several techniques concerned with the concept of disparity compensation have been developed. For the compression of multi-view images, the concepts of disparity compensation and epipolar plane image (EPI) are the efficient ways of exploiting redundancies between multiple views. These techniques, however, heavily depend on the limited camera configurations. In order to consider many other multi-view configurations and other types of 3-D images comprehensively, more general platform for the 3-D image representation is introduced, aiming to outgrow the framework of 3-D “image” communication and to open up a novel field of technology, which should be called the “spatial” communication. Especially, the light ray based method has a wide range of application, including efficient transmission of the physical world, as well as integration of the virtual and physical worlds. key words: 3-D image coding, stereo images, multi-view images, panoramic images, volumetric images, holograms, displayindependent representation, light rays, spatial communication

[1]  Alan C. Bovik,et al.  Stereo image compression using VPIC , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[2]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[3]  Takeshi Naemura,et al.  Three-Dimensional Image. Handling of 3-D Objects using Ray Space. , 1996 .

[4]  Emile A. Hendriks,et al.  Recursive disparity estimation algorithm for real time stereoscopic video applications , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[5]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[7]  Jake K. Aggarwal,et al.  Determining object motion in a sequence of stereo images , 1987, IEEE Journal on Robotics and Automation.

[8]  Avishai Henik,et al.  On the compression of stereo images: Preliminary results , 1989 .

[9]  Wa James Tam,et al.  Stereoscopic image coding: Effect of disparate image-quality in left- and right-eye views , 1998, Signal Process. Image Commun..

[10]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[11]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Ebroul Izquierdo.  Stereo matching for enhanced telepresence in three-dimensional videocommunications , 1997, IEEE Trans. Circuits Syst. Video Technol..

[13]  Jiebo Luo,et al.  Coherently three-dimensional wavelet-based approach to volumetric image compression , 1998, J. Electronic Imaging.

[14]  Thomas S. Huang,et al.  Motion and structure from feature correspondences: a review , 1994, Proc. IEEE.

[15]  M. Lukacs,et al.  Predictive coding of multi-viewpoint image sets , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  A. Murat Tekalp,et al.  Simultaneous motion-disparity estimation and segmentation from stereo , 1994, Proceedings of 1st International Conference on Image Processing.

[17]  Allen M. Waxman,et al.  Dynamic Stereo: Passive Ranging to Moving Objects from Relative Image Flows , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Jens-Rainer Ohm,et al.  A realtime hardware system for stereoscopic videoconferencing with viewpoint adaptation , 1998, Signal Process. Image Commun..

[19]  Hiroshi Yoshikawa,et al.  Holographic image compression by motion picture coding , 1996, Electronic Imaging.

[20]  Ahmed Tamtaoui,et al.  Constrained disparity and motion estimators for 3DTV image sequence coding , 1991, Signal Process. Image Commun..

[21]  Michael G. Strintzis,et al.  Object-based coding of stereo image sequences using three-dimensional models , 1997, IEEE Trans. Circuits Syst. Video Technol..

[22]  Dimitrios Tzovaras,et al.  Motion and disparity estimation using rate-distortion theory for very low bit rate and multiview image sequence coding , 1997, Electronic Imaging.

[23]  King Ngi Ngan,et al.  Disparity map coding based on adaptive triangular surface modelling , 1998, Signal Process. Image Commun..

[24]  Allen M. Waxman,et al.  Binocular Image Flows: Steps Toward Stereo-Motion Fusion , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[26]  M. G. Strintzis,et al.  Joint motion/disparity MAP estimation for stereo Image sequences , 1996 .

[27]  Dimitris Anastassiou,et al.  A theoretical study on an accurate reconstruction of multiview images based on the Viterbi algorithm , 1995, Proceedings., International Conference on Image Processing.

[28]  Michael G. Perkins,et al.  Data compression of stereopairs , 1992, IEEE Trans. Commun..

[29]  K Oshima,et al.  Synthesis of an autostereoscopic 3-D image from binocular stereoscopic images. , 1979, Applied optics.

[30]  Monson H. Hayes,et al.  Stereo image coding: a projection approach , 1998, IEEE Trans. Image Process..

[31]  Masahide Kaneko,et al.  3D segmentation of multiview images based on disparity estimation , 1996, Other Conferences.

[32]  Tim J. Dennis,et al.  Reconstruction of intermediate views from stereoscopic images using a rational filter , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[33]  Emile A. Hendriks,et al.  Disparity map coding for 3D teleconferencing applications , 1997, Electronic Imaging.

[34]  Mel W. Siegel,et al.  A multiresolution framework for stereoscopic image sequence compression , 1994, Proceedings of 1st International Conference on Image Processing.

[35]  Manfred Ziegler,et al.  Evolution of stereoscopic and three-dimensional video , 1998, Signal Process. Image Commun..

[36]  Raghu Machiraju,et al.  Two-dimensional sequence compression using MPEG , 1998, Electronic Imaging.

[37]  Belle L. Tseng,et al.  Multiviewpoint video coding with MPEG-2 compatibility , 1996, IEEE Trans. Circuits Syst. Video Technol..

[38]  Kiyoharu Aizawa,et al.  Model-based image coding advanced video coding techniques for very low bit-rate applications , 1995, Proc. IEEE.

[39]  Jin Liu,et al.  A three camera approach for calculating disparity and synthesizing intermediate pictures , 1991, Signal Process. Image Commun..

[40]  Mahmood R. Azimi-Sadjadi,et al.  2-D filter-based disparity compensation using sequential orthogonal subspace updating , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[41]  Jens-Rainer Ohm,et al.  An object-based system for stereoscopic viewpoint synthesis , 1997, IEEE Trans. Circuits Syst. Video Technol..

[42]  Wayne O. Cochran,et al.  Fractal Volume Compression , 1996, IEEE Trans. Vis. Comput. Graph..

[43]  M.Ebroul Izquierdo.  Stereo image analysis for multi-viewpoint telepresence applications , 1998 .

[44]  Hiroyuki Yamaguchi,et al.  Stereoscopic images disparity for predictive coding , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[45]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[46]  Nikolaos Grammalidis,et al.  Disparity field and depth map coding for multiview 3D image generation , 1998, Signal Process. Image Commun..

[47]  Antonio Ortega,et al.  Dependent quantization for stereo image coding , 1998, Electronic Imaging.

[48]  T. Motoki,et al.  Present status of three-dimensional television research , 1995, Proc. IEEE.

[49]  Nikolaos Grammalidis,et al.  Object-based coding of stereo image sequences using joint 3-D motion/disparity compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..