Exploring strategies and guidelines for developing full body video game interfaces

We present a Wizard-of-Oz study exploring full body video game interaction. Using the commercial video game Mirror's Edge, players are presented with several different tasks such as running, jumping, and climbing. Following our protocol, participants were given complete freedom in choosing the motions and gestures to compete these tasks. Our experiment results show a mix of natural and constrained gestures adapted to space and field of view restrictions. We present guidelines for future full body interfaces.

[1]  Joseph A. Paradiso,et al.  PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play , 1999, CHI '99.

[2]  Emiko Charbonneau,et al.  Understanding visual interfaces for the next generation of dance-based rhythm video games , 2009, SIGGRAPH 2009.

[3]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[4]  Jessica K. Hodgins,et al.  Accelerometer-based user interfaces for the control of a physically simulated character , 2008, SIGGRAPH 2008.

[5]  Hiroo Iwata,et al.  Virtual perambulator: a novel interface device for locomotion in virtual environment , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[6]  Joseph J. LaViola,et al.  RealNav: Exploring natural user interfaces for locomotion in video games , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[7]  Alex Pentland,et al.  The ALIVE system: wireless, full-body interaction with autonomous agents , 1997, Multimedia Systems.

[8]  Emiko Charbonneau,et al.  The Wiimote and Beyond: Spatially Convenient Devices for 3D User Interfaces , 2010, IEEE Computer Graphics and Applications.

[9]  R. Zajonc.  SOCIAL FACILITATION. , 1965, Science.

[10]  Joseph J. LaViola,et al.  Exploring 3D gestural interfaces for music creation in video games , 2009, FDG.

[11]  Doug A. Bowman,et al.  Travel in immersive virtual environments: an evaluation of viewpoint motion control techniques , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[12]  Victoria Interrante,et al.  Seven League Boots: A New Metaphor for Augmented Locomotion through Moderately Large Scale Immersive Virtual Environments , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[13]  Randy F. Pausch,et al.  Generating 3D interaction techniques by identifying and breaking assumptions , 2006, Virtual Reality.

[14]  Anna De Fina,et al.  The ethnographic interview , 2019, The Routledge Handbook of Linguistic Ethnography.

[15]  Gerd Bruder,et al.  Presence-enhancing real walking user interface for first-person video games , 2009, Sandbox@SIGGRAPH.

[16]  Doug A. Bowman,et al.  Exploring individual differences in raybased selection: strategies and traits , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[17]  Frank J. Lee,et al.  Wiizards: 3D gesture recognition for game play input , 2007, Future Play.

[18]  Alan Wexelblat,et al.  An approach to natural gesture in virtual environments , 1995, TCHI.

[19]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[20]  Joseph J. LaViola,et al.  Breaking the status quo: Improving 3D gesture recognition with spatially convenient input devices , 2010, 2010 IEEE Virtual Reality Conference (VR).

[21]  Doug A. Bowman,et al.  New Directions in 3D User Interfaces , 2005, Int. J. Virtual Real..

[22]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[23]  Bill Buxton,et al.  Sketching User Experiences: Getting the Design Right and the Right Design , 2007 .

[24]  Doug A. Bowman,et al.  A methodology for the evaluation of travel techniques for immersive virtual environments , 1998, Virtual Reality.

[25]  Paul Anderson,et al.  Gameplay issues in the design of spatial 3D gestures for video games. , 2006, CHI EA '06.

[26]  Sharif Razzaque,et al.  The hand is slower than the eye: a quantitative exploration of visual dominance over proprioception , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..