Modeling from reality

This paper presents an overview of our efforts in modeling-from-realty to create virtual reality models through observation of real objects. These efforts span three aspects: how to create geometric models of virtual objects; how to create photometric models of virtual objects; and how to integrate such virtual objects with real scenes. For geometric model creation, we have developed a two-step method: simultaneous alignment and volumetric view merging. For photometric model creation, we have developed two methods, model-based and eigen-texture rendering methods, both of which automatically create models by observing the real objects. For the integration of virtual objects with real scenes, we have developed a method that renders virtual objects based on real illumination distribution. We have successfully tested the proposed methods by using real images to demonstrate their effectiveness.

[1]  Kosuke Sato,et al.  Determining Reflectance Properties of an Object Using Range and Brightness Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[3]  Katsushi Ikeuchi,et al.  Illumination distribution from shadows , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Katsushi Ikeuchi,et al.  Temporal-color space analysis of reflection , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[6]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[7]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[8]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[9]  Katsushi Ikeuchi,et al.  Consensus surfaces for modeling 3D objects from multiple range images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[10]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[11]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[12]  Michael Bajura,et al.  Merging Virtual Objects with the Real World , 1992 .

[13]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[14]  A. Fournier,et al.  Common Illumination between Real and Computer Generated Scenes , 1992 .

[15]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[17]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[18]  Marc Levoy,et al.  The digital Michelangelo project , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[19]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[20]  T. Caelli,et al.  Inverting an illumination model from range and intensity maps , 1994 .

[21]  Zhengyou Zhang,et al.  Modeling geometric structure and illumination variation of a scene from real images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.