A Walking-in-Place Method for Virtual Reality Using Position and Orientation Tracking

People are interested in traveling in an infinite virtual environment, but no standard navigation method exists yet in Virtual Reality (VR). The Walking-In-Place (WIP) technique is a navigation method that simulates movement to enable immersive travel with less simulator sickness in VR. However, attaching the sensor to the body is troublesome. A previously introduced method that performed WIP using an Inertial Measurement Unit (IMU) helped address this problem. That method does not require placement of additional sensors on the body. That study proved, through evaluation, the acceptable performance of WIP. However, this method has limitations, including a high step-recognition rate when the user does various body motions within the tracking area. Previous works also did not evaluate WIP step recognition accuracy. In this paper, we propose a novel WIP method using position and orientation tracking, which are provided in the most PC-based VR HMDs. Our method also does not require additional sensors on the body and is more stable than the IMU-based method for non-WIP motions. We evaluated our method with nine subjects and found that the WIP step accuracy was 99.32% regardless of head tilt, and the error rate was 0% for squat motion, which is a motion prone to error. We distinguish jog-in-place as “intentional motion” and others as “unintentional motion”. This shows that our method correctly recognizes only jog-in-place. We also apply the saw-tooth function virtual velocity to our method in a mathematical way. Natural navigation is possible when the virtual velocity approach is applied to the WIP method. Our method is useful for various applications which requires jogging.

[1]  Majed Al Zayer,et al.  Handsfree Omnidirectional VR Navigation using Head Tilt , 2017, CHI.

[2]  Steve Aukstakalnis,et al.  Practical Augmented Reality: A Guide to the Technologies, Applications, and Human Factors for AR and VR , 2016 .

[3]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[4]  Craig R Sherman,et al.  Motion sickness: review of causes and preventive strategies. , 2006, Journal of travel medicine.

[5]  Michèle Courant,et al.  Walking-pad: a step-in-place locomotion interface for virtual environments , 2004, ICMI '04.

[6]  Francis K. H. Quek,et al.  Sensor-fusion walking-in-place interaction technique using mobile devices , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[7]  Betsy Williams Sanders,et al.  VR locomotion: walking > walking in place > arm swinging , 2016, VRCAI.

[8]  Tuncay Cakmak,et al.  Cyberith virtualizer: a locomotion device for virtual reality , 2014, SIGGRAPH '14.

[9]  Neil Zhao Full-Featured Pedometer Design Realized with 3-Axis Digital Accelerometer , 2010 .

[10]  Maud Marchal,et al.  Shake-your-head: revisiting walking-in-place for desktop virtual reality , 2010, VRST '10.

[11]  Rajiv V. Dubey,et al.  Point & Teleport Locomotion Technique for Virtual Reality , 2016, CHI PLAY.

[12]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[13]  Mary C. Whitton,et al.  Reliable forward walking parameters from head-track data alone , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[14]  Sang Chul Ahn,et al.  Active panoramic VR video play using low latency step detection on smartphone , 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE).

[15]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[16]  Timothy P. McNamara,et al.  Exploring large virtual environments with an HMD when physical space is limited , 2007, APGV.

[17]  Mary C. Whitton,et al.  LLCM-WIP: Low-Latency, Continuous-Motion Walking-in-Place , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[18]  Mel Slater,et al.  The Virtual Treadmill: A Naturalistic Metaphor for Navigation in Immersive Virtual Environments , 1995, Virtual Environments.

[19]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[20]  Luc Van Gool,et al.  Motion Control of the CyberCarpet Platform , 2013, IEEE Transactions on Control Systems Technology.

[21]  Young Soo Suh,et al.  Pedestrian Navigation Using Foot-Mounted Inertial Sensor and LIDAR , 2016, Sensors.

[22]  Thies Pfeiffer,et al.  Detecting movement patterns from inertial data of a mobile head-mounted-display for navigation via walking-in-place , 2016, 2016 IEEE Virtual Reality (VR).

[23]  Betsy Williams Sanders,et al.  Evaluation of walking in place on a Wii balance board to explore a virtual environment , 2011, TAP.

[24]  Sharif Razzaque,et al.  Redirected Walking , 2001, Eurographics.

[25]  Rudy Darken,et al.  The omni-directional treadmill: a locomotion device for virtual worlds , 1997, UIST '97.

[26]  Takuji Narumi,et al.  Unlimited corridor: redirected walking techniques using visuo haptic interaction , 2016, SIGGRAPH Emerging Technologies.

[27]  Patricia S. Denbrook,et al.  Virtual Locomotion: Walking in Place through Virtual Environments , 1999, Presence.

[28]  Mary C. Whitton,et al.  15 Years of Research on Redirected Walking in Immersive Virtual Environments , 2018, IEEE Computer Graphics and Applications.

[29]  Hanne Brinks,et al.  Redesign of the Omnideck platform : With respect to DfA and modularity , 2016 .

[30]  Timothy P. McNamara,et al.  Do We Need to Walk for Effective Virtual Reality Navigation? Physical Rotations Alone May Suffice , 2010, Spatial Cognition.

[31]  Judy Kay,et al.  VRun: running-in-place virtual reality exergame , 2016, OZCHI.

[32]  Sachin Katti,et al.  Position Tracking for Virtual Reality Using Commodity WiFi , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Mary C. Whitton,et al.  GUD WIP: Gait-Understanding-Driven Walking-In-Place , 2010, 2010 IEEE Virtual Reality Conference (VR).

[34]  Lei Ren,et al.  Position Tracking During Human Walking Using an Integrated Wearable Sensing System , 2017, Sensors.

[35]  Michael E. McCauley,et al.  Cybersickness: Perception of Self-Motion in Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[36]  Eelke Folmer,et al.  VR-STEP: Walking-in-Place using Inertial Sensing for Hands Free Navigation in Mobile VR Environments , 2016, CHI.

[37]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[38]  Li Li,et al.  The Accuracy and Precision of Position and Orientation Tracking in the HTC Vive Virtual Reality System for Scientific Research , 2017, i-Perception.

[39]  Gerd Bruder,et al.  Bending the Curve: Sensitivity to Bending of Curved Paths and Application in Room-Scale VR , 2017, IEEE Transactions on Visualization and Computer Graphics.

[40]  Fernando Seco Granja,et al.  PDR with a Foot-Mounted IMU and Ramp Detection , 2011, Sensors.

[41]  Eelke Folmer,et al.  Legomotion: scalable walking-based virtual locomotion , 2017, VRST.

[42]  Thomas Seel,et al.  IMU-Based Joint Angle Measurement for Gait Analysis , 2014, Sensors.

[43]  Suzanne Weghorst,et al.  Virtusphere: Walking in a Human Size VR “Hamster Ball” , 2008 .

[44]  A Rudins,et al.  Foot biomechanics during walking and running. , 1994, Mayo Clinic proceedings.