A new taxonomy for locomotion in virtual environments

The concept of virtual reality, although evolving due to technological advances, has always been fundamentally defined as a revolutionary way for humans to interact with computers. The revolution comes from the concept of immersion, which is the essence of virtual reality. Users are no longer passive observers of information, but active participants that have leaped through the computer screen and are now part of the information. This has tremendous implications on how users interact with computer information in the virtual world. Perhaps the most common form of interaction in a virtual environment is locomotion. The term locomotion is used to indicate a user's control of movement through the virtual environment. There are many ways for a user to change his viewpoint in the virtual world. Because virtual reality is a relatively young field, no standard interfaces exist for interaction, particularly locomotion, in a virtual world. There have been few attempts to formally classify the ways in which virtual locomotion can occur. These classification schemes do not take into account the various interaction devices such as joysticks and vehicle mock-ups that are used to perform the locomotion. Nor do they account for the differences in display devices, such as head-mounted displays, monitors, or projected walls. This work creates a new classification system for virtual locomotion methods. The classification provides guidelines for designers of new VR applications, on what types of locomotion are best suited to the requirements of new applications. Unlike previous taxonomies, this work incorporates display devices, interaction devices, and travel tasks, along with identifying two major components of travel: translation and rotation. The classification also identifies important sub-components of these two. In addition, we have experimentally validated the importance of display device and rotation method in this new classification system. This was accomplished through a large-scale user experiment. Users performed an architectural walkthrough of a virtual building. Both objective and subjective measures indicate that choice of display device is extremely important to the task of locomotion, and that for each display device, the choice of rotation method is also important.

[1]  Tinsley A. Galyean Guided navigation of virtual environments , 1995, I3D '95.

[2]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[3]  Andreas Buja,et al.  Xgobi: Interactive Dynamic Graphics In The X Window System With A Link To S , 1991 .

[4]  Michael A. Gigante Virtual Reality: Enabling Technologies , 1993, Virtual Reality Systems.

[5]  Carolina Cruz-Neira,et al.  The Effect of Different Viewing Devices for the Sense of Presence of Immersion in Virtual Environments: A Comparison of Stereoprojections Based on Monitors, HMDs and Screens , 1997, HCI.

[6]  Jock D. Mackinlay,et al.  Rapid controlled movement through a virtual 3D workspace , 1990, SIGGRAPH.

[7]  Robert J. K. Jacob,et al.  The perceptual structure of multidimensional input device selection , 1992, CHI.

[8]  Carolina Cruz-Neira,et al.  The benefits of statistical visualization in an immersive environment , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[9]  L. Kozlowski,et al.  Sense of direction, spatial orientation, and cognitive maps. , 1977 .

[10]  Ravin Balakrishnan,et al.  Reaching for objects in VR displays: lag and frame rate , 1994, TCHI.

[11]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[12]  Colin Ware,et al.  Using Velocity Control to Navigate 3D Graphical Environments: A Comarison of three Interfaces , 1991 .

[13]  Randy F. Pausch,et al.  Navigation and locomotion in virtual worlds via flight into hand-held miniatures , 1995, SIGGRAPH.

[14]  David Zeltzer,et al.  Autonomy, Interaction, and Presence , 1992, Presence: Teleoperators & Virtual Environments.

[15]  William Ribarsky,et al.  Evaluation of the effects of frame time variation on VR task performance , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[16]  P A Hancock,et al.  The perception of spatial layout in real and virtual worlds. , 1997, Ergonomics.

[17]  Warren Robinett,et al.  Synthetic Experience:A Proposed Taxonomy , 1992, Presence: Teleoperators & Virtual Environments.

[18]  Patrick Péruch,et al.  Acquisition of Spatial Knowledge Through Visual Exploration of Simulated Environments , 1995 .

[19]  J. Rieser Access to knowledge of spatial structure at novel points of observation. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[20]  Hiroo Iwata,et al.  Virtual perambulator: a novel interface device for locomotion in virtual environment , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[21]  Frederick P. Brooks,et al.  Towards image realism with interactive update rates in complex virtual building environments , 1990, I3D '90.

[22]  Wayne L. Shebilske,et al.  Virtual Reality: An Instructional Medium for Visual-Spatial Tasks. , 1992 .

[23]  Jock D. Mackinlay,et al.  The information visualizer, an information workspace , 1991, CHI.

[24]  Frederick P. Brooks What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[25]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[26]  Ken Pimentel,et al.  Virtual reality - through the new looking glass , 1993 .

[27]  Paul Milgram,et al.  A Comparative Study of Rotational and Stereoscopic Computer Graphic Depth Cues , 1991 .

[28]  C C Presson,et al.  Updating after Rotational and Translational Body Movements: Coordinate Structure of Perspective Space , 1994, Perception.

[29]  Dennis Proffitt,et al.  Quantifying immersion in virtual reality , 1997, SIGGRAPH.

[30]  James C. Chung A comparison of head-tracked and non-head-tracked steering modes in the targeting of radiotherapy treatment beams , 1992, I3D '92.

[31]  Carlo H. Séquin,et al.  Adaptive display algorithm for interactive frame rates during visualization of complex virtual environments , 1993, SIGGRAPH.

[32]  George W. Fitzmaurice,et al.  Exploring interactive curve and surface manipulation using a bend and twist sensitive input strip , 1999, SI3D.

[33]  Ken Hinckley,et al.  A survey of design issues in spatial input , 1994, UIST '94.

[34]  Henry Sowizral,et al.  Embedding the 2D interaction metaphor in a real 3D virtual environment , 1995, Electronic Imaging.

[35]  Mark R. Mine,et al.  Virtual Environment Interaction Techniques , 1995 .

[36]  Doug A. Bowman,et al.  The Educational Value of an Information-Rich Virtual Environment , 1999, Presence: Teleoperators & Virtual Environments.

[37]  Woodrow Barfield,et al.  Presence in virtual environments as a function of visual and auditory cues , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[38]  Randy F. Pausch,et al.  Voodoo dolls: seamless interaction at multiple scales in virtual environments , 1999, SI3D.

[39]  Doug A. Bowman,et al.  The Virtual Venue: User-Computer Interaction in Information-Rich Virtual Environments , 1998, Presence.

[40]  Jack M. Loomis,et al.  Locomotion Mode Affects the Updating of Objects Encountered During Travel: The Contribution of Vestibular and Proprioceptive Inputs to Path Integration , 1998, Presence.

[41]  P Péruch,et al.  Homing in Virtual Environments: Effects of Field of View and Path Layout , 1997, Perception.

[42]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[43]  Michael Gleicher,et al.  The challenges of 3D interaction , 1994, CHI Conference Companion.

[44]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[45]  Terry Allard,et al.  Spatial Orientation and Wayfinding in Large-Scale Virtual Spaces: An Introduction , 1998, Presence.

[46]  Colin Ware,et al.  Evaluating stereo and motion cues for visualizing information nets in three dimensions , 1996, TOGS.

[47]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[48]  Carolina Cruz-Neira,et al.  XGobi vs the C2: Results of an experiment comparing data visualization in a 3-D immersive virtual reality environment with a 2-D workstation display , 1999, Comput. Stat..

[49]  G. Michel,et al.  Restricting the Field of View: Perceptual and Performance Effects , 1990, Perceptual and motor skills.

[50]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[51]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[52]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[53]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[54]  John A. Vince,et al.  Virtual reality systems , 1995 .

[55]  Warren Robinett,et al.  Implementation of flying, scaling and grabbing in virtual worlds , 1992, I3D '92.

[56]  Terry Allard,et al.  Spatial Orientation and Wayfinding in Large-Scale Virtual Spaces II: Guest Editors' Introduction , 1999, Presence.

[57]  Jakob Nielsen,et al.  Noncommand user interfaces , 1993, CACM.

[58]  Roy Kalawsky,et al.  The science of virtual reality and virtual environments - a technical, scientific and engineering reference on virtual environments , 1993 .

[59]  G. Drew Kessler A framework for interactors in immersive virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[60]  Doug A. Bowman,et al.  Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual Environments , 1999, J. Vis. Lang. Comput..

[61]  James P. Bliss,et al.  The Virtual Environment Performance Assessment Battery (VEPAB):Development and Evaluation1 , 1994, Presence: Teleoperators & Virtual Environments.

[62]  Thomas Erickson,et al.  Interactive scientific visualization: An assessment of a virtual reality system , 1990, INTERACT.

[63]  Dennis Proffitt,et al.  Cooperative bimanual action , 1997, CHI.

[64]  Doug A. Bowman,et al.  Travel in immersive virtual environments: an evaluation of viewpoint motion control techniques , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[65]  R. Klatzky,et al.  Nonvisual navigation by blind and sighted: assessment of path integration ability. , 1993, Journal of experimental psychology. General.

[66]  P A Hancock,et al.  Effects of control order, augmented feedback, input device and practice on tracking performance and perceived workload. , 1996, Ergonomics.

[67]  Tsutomu Miyasato,et al.  Development of Ground Surface Simulator for Tel-E-Merge system , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[68]  Colin Ware,et al.  Exploration and virtual camera control in virtual three dimensional environments , 1990, I3D '90.

[69]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[70]  Carrie Heater,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[71]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[72]  Colin Ware,et al.  Using the bat: a six-dimensional mouse for object placement , 1988, IEEE Computer Graphics and Applications.

[73]  Woodrow Barfield,et al.  Comparison of Human Sensory Capabilities with Technical Specifications of Virtual Environment Equipment , 1995, Presence: Teleoperators & Virtual Environments.

[74]  M. May,et al.  Navigating in a Virtual Environment With Map-Acquired Knowledge: Encoding and Alignment Effects , 1995 .

[75]  Alex Pentland,et al.  Device Synchronization Using an Optimal Linear Filter , 1993, Virtual Reality Systems.

[76]  Donald B. Johnson,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 1999, Presence: Teleoperators & Virtual Environments.

[77]  Kellogg S. Booth,et al.  Fish tank virtual reality , 1993, INTERCHI.

[78]  Sarah S. Chance,et al.  Spatial Updating of Self-Position and Orientation During Real, Imagined, and Virtual Locomotion , 1998 .

[79]  Carolina Cruz-Neira Virtual reality based on multiple projection screens: the cave and its applications to computational science and engineering , 1995 .

[80]  Luis Serra,et al.  The heaven and earth virtual reality: Designing applications for novice users , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[81]  Paul N. Wilson,et al.  The effect of landmarks on route-learning in a computer-simulated environment , 1994 .

[82]  Andreas Buja,et al.  XGobi: Interactive Dynamic Data Visualization in the X Window System , 1998 .

[83]  Thomas A. Furness,et al.  Spatial perception in virtual environments: Evaluating an architectural application , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[84]  Alex Pentland,et al.  Device synchronization using an optimal linear filter , 1992, I3D '92.

[85]  Peter A. Hancock,et al.  Perceived Spatial Layout of a Simulated Scene as a Function of Experience , 1991 .

[86]  Dennis C. Neale Spatial Perception in Desktop Virtual Environments , 1996 .

[87]  L. Kozlowski,et al.  Sense of Direction, Spatial Orientation, and Cognitive Maps. , 1977 .

[88]  John H. Bailey,et al.  Virtual spaces and real world places: transfer of route knowledge , 1996, Int. J. Hum. Comput. Stud..

[89]  Kay M. Stanney,et al.  Realizing the full potential of virtual reality: human factors issues that could stand in the way , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[90]  I. Scott MacKenzie,et al.  Lag as a determinant of human performance in interactive systems , 1993, INTERCHI.

[91]  Gregory B. Newby,et al.  Virtual reality: Scientific and technological challenges , 1996 .

[92]  W KnerrBruce,et al.  The virtual environment performance assessment battery vepab , 1994 .

[93]  Michael Deering,et al.  High resolution virtual reality , 1992, SIGGRAPH.

[94]  Robert J. K. Jacob,et al.  Interacting with eye movements in virtual environments , 2000, CHI.

[95]  Matthias M. Wloka,et al.  The virtual tricorder: a uniform interface for virtual reality , 1995, UIST '95.

[96]  Carrie Heeter,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[97]  David Zeltzer,et al.  Three Dimensional Visual Display Systems for Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[98]  Terry Allard,et al.  Spatial Orientation and Wayfinding in Large-Scale Virtual Spaces. , 1999 .

[99]  Michael McKenna,et al.  Interactive viewpoint control and three-dimensional operations , 1992, I3D '92.

[100]  Rudy Darken,et al.  Navigating large virtual spaces , 1996, Int. J. Hum. Comput. Interact..

[101]  Pieter Jan Stappers,et al.  Designing in virtual reality: perception-action coupling and form semantics , 1993, CHI '93.