Consolidated manipulation of virtual and real objects

We propose a manipulation environment with virtual and real objects by providing a consolidated manipulation manner for both objects. This approach assists the user and improves the task performance of object manipulation (e.g., speed and accuracy). A limited kinds of physical laws are selected and simulated for virtual objects; at the same time, limitations on the physical laws for real objects are introduced. Accordingly, we reached a compromise between the physical laws that operate on both virtual and real objects. The proposed environment enables a user to manipulate virtual and real objects in the same manner by expecting the same response according to the same physical laws. In the environment, real objects are treated as “substantial” as they are, without using insubstantial images taken by cameras or graphical images generated from geometric shape representations of objects. It is possible to bring a real object into a virtual world on demand, according to the user’s irregular and sudden requirements, without using troublesome procedures to reconstruct the object shapes. The configuration of an object manipulation environment using a “magnetic metaphor” is shown as an example. This environment is suitable .for object manipulation in a combined virtual/real world.

[1]  Yoshifumi Kitamura,et al.  Surface Reconstruction with Triangular Patches from Multiscale Range Images , 1992, MVA.

[2]  M. Narayanan,et al.  Virtual reality applications , 1994, Proceedings of WESCON '94.

[3]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[4]  Yoshifumi Kitamura,et al.  A simple and efficient method for accurate collision detection among deformable polyhedral objects in arbitrary motion , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[5]  David E. Breen,et al.  Calibration Requirements and Procedures for a Monitor-Based Augmented Reality System , 1995, IEEE Trans. Vis. Comput. Graph..

[6]  I. S. Mackenzie,et al.  Virtual Environments and Advanced Interface Design , 1995 .

[7]  David E. Breen,et al.  Annotating Real-World Objects Using Augmented Reality , 1995, Computer Graphics.

[8]  Yoshifumi Kitamura,et al.  A sophisticated manipulation aid in a virtual environment based on the dynamic constraints among object faces , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[9]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[10]  Takeo Kanade,et al.  Virtualized Reality: Being Mobile in a Visual Scene , 1996, Object Representation in Computer Vision.

[11]  David E. Breen,et al.  Interactive Occlusion and Automatic Object Placement for Augmented Reality , 1996, Comput. Graph. Forum.

[12]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[13]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[14]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[15]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[16]  Yoshifumi Kitamura,et al.  A Sophisticated Manipulation Aid in a Virtual Environment using Dynamic Constraints among Object Faces , 1998, Presence.