Behavior Analysis of Human Locomotion in the Real World and Virtual Reality for the Manufacturing Industry

With the rise of immersive visualization techniques, many domains within the manufacturing industry are increasingly validating production processes in virtual reality (VR). The validity of the results gathered in such simulations, however, is widely unknown—in particular, with regard to human locomotion behavior. To bridge this gap, this article presents an experiment analyzing the behavioral disparity between human locomotion being performed without any equipment and in immersive VR while wearing a head-mounted display (HMD). The presented study (n = 30) is split up in three sections and covers linear walking, non-linear walking, and obstacle avoidance. Special care has been given to design the experiment so that findings are generally valid and can be applied to a wide range of domains beyond the manufacturing industry. The findings provide novel insights into the effect of immersive VR on specific gait parameters. In total, a comprehensive sample of 18.09km is analyzed. The results reveal that the HMD had a medium effect (up to 13%) on walking velocity, on non-linear walking toward an oriented target, and on clearance distance. The overall differences are modeled using multiple regression models, thus allowing the general usage within various domains. Summarizing, it can be concluded that VR can be used to analyze and plan human locomotion; however, specific details may have to be adjusted to transfer findings to the real world.

[1]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[2]  John M. Hollerbach,et al.  Inertial-Force Feedback for the Treadport Locomotion Interface , 2000, Presence: Teleoperators & Virtual Environments.

[3]  Heinrich H. Bülthoff,et al.  Gait Parameters while Walking in a Head-mounted Display Virtual Environment and the Real World , 2007, EGVE.

[4]  Kazuaki Iwata,et al.  Virtual Manufacturing Systems as Advanced Information Infrastructure for Integrating Manufacturing Resources and Activities , 1997 .

[5]  Betty J. Mohler,et al.  The influence of feedback on egocentric distance judgments in real and virtual environments , 2006, APGV '06.

[6]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[7]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[8]  Mary C. Whitton,et al.  Relating Scene-Motion Thresholds to Latency Thresholds for Head-Mounted Displays , 2009, 2009 IEEE Virtual Reality Conference.

[9]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[10]  Bradford J McFadyen,et al.  Characteristics of personal space during obstacle circumvention in physical and virtual environments. , 2008, Gait & posture.

[11]  Enrico Rukzio,et al.  Dual Reality for Production Verification Workshops: A Comprehensive Set of Virtual Methods , 2016 .

[12]  Frederick P. Brooks,et al.  Walkthrough—a dynamic graphics system for simulating virtual buildings , 1987, I3D '86.

[13]  Toshikazu Ohshima,et al.  Virtual ISU: locomotion interface for immersive VR experience in seated position (1) , 2016, SIGGRAPH Asia Posters.

[14]  Sabarish V. Babu,et al.  Evaluation of the Cognitive Effects of Travel Technique in Complex Real and Virtual Environments , 2010, IEEE Transactions on Visualization and Computer Graphics.

[15]  Joshua P. Bailey,et al.  Is the Relationship Between Stride Length, Frequency, and Velocity Influenced by Running on a Treadmill or Overground? , 2017, International journal of exercise science.

[16]  Sharif Razzaque,et al.  Redirected Walking , 2001, Eurographics.

[17]  Rudy Darken,et al.  The omni-directional treadmill: a locomotion device for virtual worlds , 1997, UIST '97.

[18]  Margaret A. Hagen James J. Gibson's ecological approach to visual perception. , 1992 .

[19]  J. Laumond,et al.  The formation of trajectories during goal‐oriented locomotion in humans. I. A stereotyped behaviour , 2007, The European journal of neuroscience.

[20]  Sharif Razzaque,et al.  Comparing VE locomotion interfaces , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[21]  B. Auvinet,et al.  Reference data for normal subjects obtained with an accelerometric device. , 2002, Gait & posture.

[22]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[23]  Gerd Bruder,et al.  Walking in Virtual Reality , 2017, ACM Trans. Appl. Percept..

[24]  Frank Steinicke,et al.  Human Walking in Virtual Environments: Perception, Technology, and Applications , 2013 .

[25]  Mark T. Bolas,et al.  Vertical Field-of-View Extension and Walking Characteristics in Head-Worn Virtual Environments , 2016, ACM Trans. Appl. Percept..

[26]  Maud Marchal,et al.  Kinematic Evaluation of Virtual Walking Trajectories , 2013, IEEE Transactions on Visualization and Computer Graphics.

[27]  Heinrich H. Bülthoff,et al.  Learning to walk in virtual reality , 2013, TAP.

[28]  Alessandro De Luca,et al.  CyberWalk: Enabling unconstrained omnidirectional walking through virtual environments , 2008, ACM Trans. Appl. Percept..

[29]  Philip W. Fink,et al.  Obstacle avoidance during walking in real and virtual environments , 2007, TAP.

[30]  Jonathan W. Kelly,et al.  Perceived Space in the HTC Vive , 2017, ACM Trans. Appl. Percept..

[31]  Mary C. Whitton,et al.  LLCM-WIP: Low-Latency, Continuous-Motion Walking-in-Place , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[32]  Mel Slater,et al.  The Virtual Treadmill: A Naturalistic Metaphor for Navigation in Immersive Virtual Environments , 1995, Virtual Environments.

[33]  M.S.J. Hashmi,et al.  Virtual reality applications in manufacturing process simulation , 2004 .

[34]  Doug A. Bowman,et al.  An Evaluation of the Effects of Hyper-Natural Components of Interaction Fidelity on Locomotion Performance in Virtual Reality , 2015, ICAT-EGVE.

[35]  Toni Giorgino,et al.  Computing and Visualizing Dynamic Time Warping Alignments in R: The dtw Package , 2009 .