Virtual vs. Real-World Pointing in Two-User Scenarios

We are investigating the utility of a projection-based stereoscopic two-user system for applications in the automotive industry. In this paper we compare real-world pointing to pointing at virtual objects in a two-user scenario. In our study we investigated the following situation: One user points at an object while the second person has to guess the referenced object. Our results indicate that pointing at objects in a virtual world is much less precise than pointing in the real world even for a well calibrated stereoscopic two-user system. Pointing techniques like outlining an object or pointing from a distance produce more errors than the corresponding real-world techniques, but they are less error prone than interactions requiring to touch a virtual object. Our findings are a first step to qualify direct interaction techniques in a multi-user projection-based system.

[1]  Philip R. Cohen,et al.  Multimodal speech-gesture interface for handfree painting on a virtual paper using partial recurrent neural networks as gesture recognizer , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[2]  Mary C. Whitton,et al.  Designing and Building the PIT: a Head-Tracked Stereo Workspace for Two Users , 1998 .

[3]  Bernd Fröhlich,et al.  The two-user Responsive Workbench: support for collaboration through individual views of a shared space , 1997, SIGGRAPH.

[4]  Kristine Nagel,et al.  Studies on the Effectiveness of Virtual Pointers in Collaborative Augmented Reality , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[5]  Dieter Kranzlmüller,et al.  Supporting social human communication between distributed walk-in displays , 2004, VRST '04.

[6]  Bernd Fröhlich,et al.  The Bent Pick Ray: An Extended Pointing Technique for Multi-User Interaction , 2006, 3D User Interfaces (3DUI'06).

[7]  Dieter Schmalstieg,et al.  The Studierstube Augmented Reality Project , 2002, Presence: Teleoperators & Virtual Environments.

[8]  Paul Milgram,et al.  Perceptual issues in augmented reality , 1996, Electronic Imaging.

[9]  Neil A. Dodgson,et al.  Variation and extrema of human interpupillary distance , 2004, IS&T/SPIE Electronic Imaging.

[10]  Daniel M. Oppenheimer,et al.  Accuracy in detecting referents of pointing gestures unaccompanied by language , 2006 .

[11]  Oliver Otto,et al.  Importance of communication influences on a highly collaborative task , 2003, Proceedings Seventh IEEE International Symposium on Distributed Simulation and Real-Time Applications.

[12]  Bernd Fröhlich,et al.  Implementing Multi-Viewer Stereo Displays , 2005, WSCG.

[13]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.