Cognitive Resource Demands of Redirected Walking

Redirected walking allows users to walk through a large-scale immersive virtual environment (IVE) while physically remaining in a reasonably small workspace. Therefore, manipulations are applied to virtual camera motions so that the user's self-motion in the virtual world differs from movements in the real world. Previous work found that the human perceptual system tolerates a certain amount of inconsistency between proprioceptive, vestibular and visual sensation in IVEs, and even compensates for slight discrepancies with recalibrated motor commands. Experiments showed that users are not able to detect an inconsistency if their physical path is bent with a radius of at least 22 meters during virtual straightforward movements. If redirected walking is applied in a smaller workspace, manipulations become noticeable, but users are still able to move through a potentially infinitely large virtual world by walking. For this semi-natural form of locomotion, the question arises if such manipulations impose cognitive demands on the user, which may compete with other tasks in IVEs for finite cognitive resources. In this article we present an experiment in which we analyze the mutual influence between redirected walking and verbal as well as spatial working memory tasks using a dual-tasking method. The results show an influence of redirected walking on verbal as well as spatial working memory tasks, and we also found an effect of cognitive tasks on walking behavior. We discuss the implications and provide guidelines for using redirected walking in virtual reality laboratories.

[1]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[2]  Matthias Zwicker,et al.  Ieee Transactions on Visualization and Computer Graphics Ewa Splatting , 2002 .

[3]  William E. Marsh,et al.  Is the user trained? Assessing performance and cognitive resource demands in the Virtusphere , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[4]  Mary C. Whitton,et al.  An evaluation of navigational ability comparing Redirected Free Exploration with Distractors to Walking-in-Place and joystick locomotio interfaces , 2011, 2011 IEEE Virtual Reality Conference.

[5]  Gerd Bruder,et al.  Estimation of Detection Thresholds for Redirected Walking Techniques , 2010, IEEE Transactions on Visualization and Computer Graphics.

[6]  I. Israël,et al.  Perception of two-dimensional, simulated ego-motion trajectories from optic flow , 2000, Vision Research.

[7]  James Park,et al.  The Brain's Sense of Movement , 2003, The Yale Journal of Biology and Medicine.

[8]  M. Woollacott,et al.  Attention and the control of posture and gait: a review of an emerging area of research. , 2002, Gait & posture.

[9]  M Usoh,et al.  Presence questionaires in reality , 2000 .

[10]  Jonathan W. Kelly,et al.  Cognitive Demands of Semi-Natural Virtual Locomotion , 2013, PRESENCE: Teleoperators and Virtual Environments.

[11]  Makoto Sato,et al.  Virtual locomotion system for large-scale virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[12]  Timo Ropinski,et al.  Moving Towards Generally Applicable Redirected Walking , 2008 .

[13]  Sandra E Black,et al.  Effect of working memory and spatial attention tasks on gait in healthy young and older adults. , 2010, Motor control.

[14]  Peter Willemsen,et al.  Effects of Stereo Viewing Conditions on Distance Perception in Virtual Environments , 2008, PRESENCE: Teleoperators and Virtual Environments.

[15]  Eric Burns,et al.  Combining passive haptics with redirected walking , 2005, ICAT '05.

[16]  S. Grill Postural instability in Parkinson's disease. , 1999, Maryland medical journal.

[17]  Hiroo Iwata,et al.  Powered shoes , 2006, SIGGRAPH '06.

[18]  Sabarish V. Babu,et al.  Comparison of path visualizations and cognitive measures relative to travel technique in a virtual environment , 2005, IEEE Transactions on Visualization and Computer Graphics.

[19]  Jesse C. Dean,et al.  The Effect of Lateral Stabilization on Walking in Young and Old Adults , 2007, IEEE Transactions on Biomedical Engineering.

[20]  Sharif Razzaque,et al.  Redirected Walking , 2001, Eurographics.

[21]  Roy A. Ruddle,et al.  The benefits of using a walking interface to navigate virtual environments , 2009, TCHI.

[22]  Heinz Ulbrich,et al.  Cyberwalk: Implementation of a Ball Bearing Platform for Humans , 2007, HCI.

[23]  Uwe Kloos,et al.  Velocity-dependent dynamic curvature gain for redirected walking , 2011, 2011 IEEE Virtual Reality Conference.

[24]  A. Gevins,et al.  Spatiotemporal dynamics of component processes in human working memory. , 1993, Electroencephalography and clinical neurophysiology.

[25]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[26]  Hiroo Iwata,et al.  CirculaFloor , 2005, IEEE Computer Graphics and Applications.

[27]  Shirley Dex,et al.  JR 旅客販売総合システム(マルス)における運用及び管理について , 1991 .

[28]  Uwe D. Hanebeck,et al.  Telepresence Techniques for Controlling Avatar Motion in First Person Games , 2005, INTETAIN.

[29]  Alessandro De Luca,et al.  CyberWalk: Enabling unconstrained omnidirectional walking through virtual environments , 2008, ACM Trans. Appl. Percept..

[30]  Heinrich H. Bülthoff,et al.  Walking improves your cognitive map in environments that are large-scale and large in extent , 2011, TCHI.

[31]  Uwe D. Hanebeck,et al.  Motion Compression for Telepresent Walking in Large Target Environments , 2004, Presence: Teleoperators & Virtual Environments.

[32]  Gerd Bruder,et al.  A taxonomy for deploying redirection techniques in immersive virtual environments , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[33]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[34]  Mary C. Whitton,et al.  Evaluation of Reorientation Techniques for Walking in Large Virtual Environments , 2008, 2008 IEEE Virtual Reality Conference.

[35]  G. Bower,et al.  THE PSYCHOLOGY OF LEARNING AND M·OTIVATION , 2001 .

[36]  Mel Slater,et al.  Using Presence Questionnaires in Reality , 2000, Presence: Teleoperators & Virtual Environments.

[37]  J William,et al.  IEEE Computer Graphics and Applications , 2019, Computer.

[38]  Hiroo Iwata,et al.  CirculaFloor [locomotion interface] , 2005, IEEE Computer Graphics and Applications.

[39]  K. Aminian,et al.  Dual-task-related gait changes in the elderly: does the type of cognitive task matter? , 2005, Journal of motor behavior.

[40]  F. Bremmer,et al.  Perception of self-motion from visual flow , 1999, Trends in Cognitive Sciences.

[41]  J. Dichgans,et al.  Visual-Vestibular Interaction: Effects on Self-Motion Perception and Postural Control , 1978 .

[42]  M. Morris,et al.  Postural instability in Parkinson's disease: a comparison with and without a concurrent task. , 2000, Gait & posture.

[43]  A. Baddeley Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[44]  B. Bussel,et al.  Evidence for Cognitive Processes Involved in the Control of Steady State of Walking in Healthy Subjects and after Cerebral Damage , 2005, Neurorehabilitation and neural repair.

[45]  Josef F. Krems,et al.  Situation Awareness and Secondary Task Performance While Driving , 2007, HCI.

[46]  Frank Steinicke,et al.  Human Walking in Virtual Environments: Perception, Technology, and Applications , 2013 .