Multisensory interaction metaphors with haptics and proprioception in virtual environments

For several years, virtual environments (VEs) are promising applications to explore and manipulate 3D data and 3D worlds. Those environments are designed to be intuitive and easy to use, however, in practice no ideal solution has been proposed yet. Designers and researchers always have to make compromises due to the complexity of the human senses and technical and financial restrictions. It is widely accepted that multisensory metaphors dramatically can improve the user's performance when interaction in a VE. In this paper, we present a modelling application, for research purposes, called nVRment, which uses and combines several interaction metaphors. The aim of this application is to test in practice our newly proposed metaphors: the "Object In Hand" metaphor, which uses proprioception together with force feedback for manipulations and the "Small Scene Manipulation" which is suitable for manipulation of an object in its local context.

[1]  Mark R. Mine ISAAC: A Virtual Environment Tool for the Interactive Construction of Virtual Worlds , 1995 .

[2]  Ravin Balakrishnan,et al.  Symmetric bimanual interaction , 2000, CHI.

[3]  Karin Coninx,et al.  Haptic Camera Manipulation : Extending the “ Camera In Hand Metaphor ” , 2002 .

[4]  Gerd Johansson,et al.  Special Considerations for Navigation and Interaction in Virtual Environments for People with Brain Injury , 2000 .

[5]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[6]  Karin Coninx,et al.  Expanding the haptic experience by using the PHANToM device to drive a camera metaphor , 2001 .

[7]  Y. Guiard Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[8]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[9]  T. Ichikawa,et al.  Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques , 1998, Comput. Graph. Forum.

[10]  Desney S. Tan,et al.  Exploring 3D navigation: combining speed-coupled flying with orbiting , 2001, CHI.

[11]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[12]  Colin Ware,et al.  Exploration and virtual camera control in virtual three dimensional environments , 1990, I3D '90.

[13]  Philip R. Cohen The role of natural language in a multimodal interface , 1992, UIST '92.

[14]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[15]  John Kenneth Salisbury,et al.  Making graphics physically tangible , 1999, CACM.

[16]  Randy F. Pausch,et al.  Voodoo dolls: seamless interaction at multiple scales in virtual environments , 1999, SI3D.

[17]  Mark R. Mine,et al.  Working in a Virtual World: Interaction Techniques Used in the Chapel Hill Immersive Modeling Program , 1996 .