Interaction between real and virtual humans: playing checkers

For some years, we have been able to integrate virtual humans into virtual environments. As the demand for Augmented Reality systems grows, so will the need for these synthetic humans to coexist and interact with humans who live in the real world. In this paper, we use the example of a checkers game between a real and a virtual human to demonstrate the integration of techniques required to achieve a realistic- looking interaction in real-time. We do not use cumbersome devices such as a magnetic motion capture system. Instead, we rely on purely image- based techniques to address the registration issue, when the camera or the objects move, and to drive the virtual human's behavior.

[1]  George Wolberg,et al.  Digital image warping , 1990 .

[2]  Daniel Thalmann,et al.  Animating virtual actors in real environments , 1997, Multimedia Systems.

[3]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[4]  Daniel Thalmann,et al.  Computer Animation , 1990, Computer Science Workbench.

[5]  Patrick Bouthemy,et al.  Robust real-time visual tracking using a 2D-3D model-based approach , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Tolga Capin,et al.  Avatars in Networked Virtual Environments , 1999 .

[7]  David E. Breen,et al.  Real-time vision-based camera tracking for augmented reality applications , 1997, VRST '97.

[8]  Daniel Thalmann,et al.  Interacting with Virtual Humans through Body Actions , 1998, IEEE Computer Graphics and Applications.

[9]  Michael Gervautz,et al.  Collaborative gaming in augmented reality , 1998, VRST '98.

[10]  David E. Breen,et al.  Confluence of Computer Vision and Interactive Graphies for Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[11]  Daniel Thalmann,et al.  The HUMANOID Environment for Interactive Animation of Multiple Deformable Human Characters , 1995, Comput. Graph. Forum.

[12]  Daniel Thalmann,et al.  Interaction between real and virtual humans in augmented reality , 1997, Proceedings. Computer Animation '97 (Cat. No.97TB100120).

[13]  Daniel Thalmann,et al.  VHD: a system for directing real-time virtual actors , 1999, The Visual Computer.

[14]  Pascal Fua,et al.  Model-Based Optimization: An Approach to Fast, Accurate, and Consistent Site Modeling from Imagery , 1997 .

[15]  Jean-Philippe Tarel,et al.  Camcal v1.0 Manual A Complete Software Solution for Camera Calibration , 1996 .

[16]  Michael A. Saunders,et al.  MINOS 5. 0 user's guide , 1983 .