Appearance modeling for mixed reality: photometric aspects

Presents an overview of our efforts on mixed reality. These efforts span two aspects: how to create models of virtual objects and how to integrate such virtual objects with real scenes. For model creation, we have developed two methods (the model-based and eigen-texture rendering methods), both of which automatically create models by observing real objects. For the integration of a virtual object with a real scene, we have developed a method that renders virtual objects based on the real illumination distribution. We have successfully tested the proposed methods by using real images to demonstrate their effectiveness.

[1]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[2]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[3]  Katsushi Ikeuchi,et al.  Consensus surfaces for modeling 3D objects from multiple range images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[4]  FuchsHenry,et al.  Merging virtual objects with the real world , 1992 .

[5]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[6]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[7]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[8]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[9]  Katsushi Ikeuchi,et al.  Temporal-color space analysis of reflection , 1994 .

[10]  T. Caelli,et al.  Inverting an illumination model from range and intensity maps , 1994 .

[11]  A. Fournier,et al.  Common Illumination between Real and Computer Generated Scenes , 1992 .

[12]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[14]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[15]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[16]  Michael Bajura,et al.  Merging Virtual Objects with the Real World , 1992 .

[17]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[18]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[19]  Katsushi Ikeuchi,et al.  Illumination distribution from shadows , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[20]  Katsushi Ikeuchi,et al.  Temporal-color space analysis of reflection , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Zhengyou Zhang,et al.  Modeling geometric structure and illumination variation of a scene from real images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[23]  Kosuke Sato,et al.  Determining Reflectance Properties of an Object Using Range and Brightness Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..