Towards Sneaking as a Playful Input Modality for Virtual Environments

Using virtual reality setups, users can fade out of their surroundings and dive fully into a thrilling and appealing virtual environment. The success of such immersive experiences depends heavily on natural and engaging interactions with the virtual world. As developers tend to focus on intuitive hand controls, other aspects of the broad range of full-body capabilities are easily left vacant. One repeatedly overlooked input modality is the user's gait. Even though users may walk physically to explore the environment, it usually does not matter how they move. However, gait-based interactions, using the variety of information contained in human gait, could offer interesting benefits for immersive experiences. For instance, stealth VR-games could profit from this additional range of interaction fidelity in the form of a sneaking-based input modality. In our work, we explore the potential of sneaking as a playful input modality for virtual environments. Therefore, we discuss possible sneaking-based gameplay mechanisms and develop three technical approaches, including precise foot-tracking and two abstraction levels. Our evaluation reveals the potential of sneaking-based inter-actions in IVEs, offering unique challenges and thrilling gameplay. For these interactions, precise tracking of individual footsteps is unnecessary, as a more abstract approach focusing on the players' intention offers the same experience while providing better comprehensible feedback. Based on these findings, we discuss the broader potential and individual strengths of our gait-centered interactions.

[1]  Concepción Perpiñá,et al.  Body Image and Virtual Reality in Eating Disorders: Is Exposure to Virtual Reality More Effective than the Classical Body Image Treatment? , 1999, Cyberpsychology Behav. Soc. Netw..

[2]  Ana Tajadura-Jiménez,et al.  As Light as your Footsteps: Altering Walking Sounds to Change Perceived Body Weight, Emotional State and Gait , 2015, CHI.

[3]  Eyal Ofek,et al.  Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller , 2018, CHI.

[4]  Yangsheng Xu,et al.  Intelligent Shoes for Human Identification , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[5]  Sang-Youn Kim,et al.  RealWalk: Feeling Ground Surfaces While Walking in Virtual Reality , 2018, CHI Extended Abstracts.

[6]  William R. Sherman,et al.  Understanding Virtual RealityInterface, Application, and Design , 2002, Presence: Teleoperators & Virtual Environments.

[7]  Nikolaus F. Troje,et al.  Retrieving Information from Human Movement Patterns , 2008 .

[8]  Stefania Serafin,et al.  Sound design and perception in walking interactions , 2009, Int. J. Hum. Comput. Stud..

[9]  Mary C. Whitton,et al.  LLCM-WIP: Low-Latency, Continuous-Motion Walking-in-Place , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[10]  Mel Slater,et al.  A note on presence terminology , 2003 .

[11]  P. Gupta,et al.  Extended Abstracts , 2002, Neonatology.

[12]  A. Kharb,et al.  A REVIEW OF GAIT CYCLE AND ITS PARAMETERS , 2011 .

[13]  M. Slater,et al.  Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes , 2013, Proceedings of the National Academy of Sciences.

[14]  L. Turchet,et al.  Examining the role of context on the recognition of walking sounds , 2010 .

[15]  Mel Slater,et al.  Drumming in Immersive Virtual Reality: The Body Shapes the Way We Play , 2013, IEEE Transactions on Visualization and Computer Graphics.

[16]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[17]  L. Ferrucci,et al.  Characteristic gait patterns in older adults with obesity--results from the Baltimore Longitudinal Study of Aging. , 2010, Journal of biomechanics.

[18]  Benjamin Bolte,et al.  The Jumper Metaphor: An Effective Navigation Technique for Immersive Display Setups , 2011 .

[19]  Gary E. Riccio,et al.  Visually Induced Motion Sickness in Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[20]  F. Biocca,et al.  Communication in the age of virtual reality , 1995 .

[21]  Robert E. Morley,et al.  In-shoe multisensory data acquisition system , 2001, IEEE Transactions on Biomedical Engineering.

[22]  R. Pastore,et al.  Auditory event perception: The source—perception loop for posture in human gait , 2008, Perception & psychophysics.

[23]  Costas Boletsis,et al.  The New Era of Virtual Reality Locomotion: A Systematic Literature Review of Techniques and a Proposed Typology , 2017, Multimodal Technol. Interact..

[24]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[25]  Eyal Ofek,et al.  I'm a Giant: Walking in Large Virtual Environments at High Speed Gains , 2019, CHI.

[26]  David Moore,et al.  HCI Lessons From PlayStation VR , 2017, CHI PLAY.

[27]  Carrie Heater,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[28]  Bruno L. Giordano,et al.  Walking and playing: what's the origin of emotional expressiveness in music? , 2006 .

[29]  W. H. Warren,et al.  Why change gaits? Dynamics of the walk-run transition. , 1995, Journal of experimental psychology. Human perception and performance.

[30]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[31]  Andrey Krekhov,et al.  Outstanding: A Multi-Perspective Travel Approach for Virtual Reality Games , 2019, CHI PLAY.

[32]  Takamichi Nakamoto,et al.  Virtual environment with smell using wearable olfactory display and computational fluid dynamics simulation , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[33]  Maud Marchal,et al.  The King-Kong Effects: Improving sensation of walking in VR with visual and tactile vibrations at each step , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[34]  Antonio Krüger,et al.  Drag:on: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift , 2019, CHI.

[35]  Mel Slater,et al.  The Virtual Treadmill: A Naturalistic Metaphor for Navigation in Immersive Virtual Environments , 1995, Virtual Environments.

[36]  Sharif Razzaque,et al.  Redirected Walking , 2001, Eurographics.

[37]  Anthony Steed,et al.  How Foot Tracking Matters: The Impact of an Animated Self-Avatar on Interaction, Embodiment and Presence in Shared Virtual Environments , 2019, Front. Robot. AI.

[38]  Marc Erich Latoschik,et al.  Any “Body” There? Avatar Visibility Effects in a Virtual Reality Game , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[39]  Andrey Krekhov,et al.  Beyond Human: Animals as an Escape from Stereotype Avatars in Virtual Reality Games , 2019, CHI PLAY.

[40]  Tabitha C. Peck,et al.  Putting yourself in the skin of a black avatar reduces implicit racial bias , 2013, Consciousness and Cognition.

[41]  Elisa D. Mekler,et al.  Statistical Significance Testing at CHI PLAY: Challenges and Opportunities for More Transparency , 2020, CHI PLAY.

[42]  Eelke Folmer,et al.  Legomotion: scalable walking-based virtual locomotion , 2017, VRST.

[43]  Robert S. Allison,et al.  New simple virtual walking method – walking on the spot , 2004 .

[44]  Victoria Interrante,et al.  Seven League Boots: A New Metaphor for Augmented Locomotion through Moderately Large Scale Immersive Virtual Environments , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[45]  Luca Turchet,et al.  Sound Synthesis and Evaluation of Interactive Footsteps and Environmental Sounds Rendering for Virtual Reality Applications , 2011, IEEE Transactions on Visualization and Computer Graphics.

[46]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[47]  Wijnand A. IJsselsteijn,et al.  Presence: concept, determinants, and measurement , 2000, Electronic Imaging.

[48]  Wolfgang Ellermeier,et al.  Audio in VR: Effects of a Soundscape and Movement-Triggered Step Sounds on Presence , 2020, Frontiers in Robotics and AI.

[49]  P. Holcomb,et al.  In: Understanding Events: How Humans See, Represent, and Act on Events. , 2007 .

[50]  Andrey Krekhov,et al.  GulliVR: A Walking-Oriented Technique for Navigation in Virtual Reality Games Based on Virtual Body Resizing , 2018, CHI PLAY.

[51]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[52]  Daniel M. Johnson,et al.  Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences , 2020, Int. J. Hum. Comput. Stud..

[53]  W Brent Edwards,et al.  When does a gait transition occur during human locomotion? , 2007, Journal of sports science & medicine.

[54]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[55]  Andrey Krekhov,et al.  Player Locomotion in Virtual Reality Games , 2020 .

[56]  Jason Alexander,et al.  The Feet in Human--Computer Interaction , 2015, ACM Comput. Surv..

[57]  Roy A. Ruddle,et al.  The benefits of using a walking interface to navigate virtual environments , 2009, TCHI.

[58]  Robert J. Logan,et al.  Perception of acoustic source characteristics: walking sounds. , 1991, The Journal of the Acoustical Society of America.

[59]  Patricia S. Denbrook,et al.  Virtual Locomotion: Walking in Place through Virtual Environments , 1999, Presence.

[60]  Luca Turchet,et al.  Extraction of ground reaction forces for real-time synthesis of walking sounds , 2009 .

[61]  Mary C. Whitton,et al.  GUD WIP: Gait-Understanding-Driven Walking-In-Place , 2010, 2010 IEEE Virtual Reality Conference (VR).

[62]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[63]  A. Imran Nordin,et al.  Immersion in Digital Games: Review of Gaming Experience Research , 2014 .

[64]  Albrecht Schmidt,et al.  VRsneaky: Increasing Presence in VR Through Gait-Aware Auditory Feedback , 2019, CHI.