Playing with All Senses: Human-Computer Interface Devices for Games

Abstract For a long time, computer games were limited to input and output devices such as mouse, joystick, typewriter keyboard, and TV screen. This has changed dramatically with the advent of inexpensive and versatile sensors, actuators, and visual and acoustic output devices. Modern games employ a wide variety of interface technology, which is bound to broaden even further. This creates a new task for game designers. They have to choose the right option, possibly combining several technologies to let one technology compensate for the deficiencies of the other or to achieve more immersion through new modes of interaction. To facilitate this endeavor, this chapter gives an overview on current and upcoming human–computer interface technologies, describes their inner workings, highlights applications in commercial games and game research, and points out promising new directions.

[1]  Dieter Schmalstieg,et al.  First steps towards handheld augmented reality , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[2]  John D. Decuir,et al.  A friendly face in robotics: Sony's AIBO entertainment robot as an educational tool , 2004, CIE.

[3]  Volker Wulf,et al.  Sports over a Distance , 2006, Personal and Ubiquitous Computing.

[4]  Tina Blaine.  The Convergence of Alternate Controllers and Musical Interfaces in Interactive Entertainment , 2005, NIME.

[5]  Enrico Costanza,et al.  Toward subtle intimate interfaces for mobile devices using an EMG controller , 2005, CHI.

[6]  Maic Masuch,et al.  Playing Audio-only Games: A compendium of interacting with virtual, auditory Worlds , 2005, DiGRA Conference.

[7]  Perttu Hämäläinen,et al.  Using heart rate to control an interactive game , 2007, CHI.

[8]  Dirk Haehnel,et al.  Are GSM Phones THE Solution for Localization? , 2006, WMCSA.

[9]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Gregory D. Abowd,et al.  Blui: low-cost localized blowable user interfaces , 2007, UIST '07.

[11]  James Scott,et al.  Audio Location: Accurate Low-Cost Location Sensing , 2005, Pervasive.

[12]  Masa Inakage,et al.  Rhythmism: a VJ performance system with maracas based devices , 2007, ACE '07.

[13]  Karon E. MacLean,et al.  Seeing, hearing, and touching: putting it all together , 2004, SIGGRAPH '04.

[14]  Marko Turpeinen,et al.  Towards Emotionally Adapted Games based on User Controlled Emotion Knobs , 2005, DiGRA Conference.

[15]  Carolina Cruz-Neira,et al.  VR Juggler: a virtual platform for virtual reality application development , 2001, Proceedings IEEE Virtual Reality 2001.

[16]  Andreas Schrader,et al.  Tangible Interfaces for Pervasive Gaming , 2005, DiGRA Conference.

[17]  Mark Billinghurst,et al.  Face to face collaborative AR on mobile phones , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[18]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[19]  Martin R. Gibbs,et al.  Remote impact: shadowboxing over a distance , 2009, CHI Extended Abstracts.

[20]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[21]  Abdulmotaleb El-Saddik,et al.  A guided tour in haptic audio visual environments and applications , 2007, Int. J. Adv. Media Commun..

[22]  Klaus-Robert Müller,et al.  Berlin Brain-Computer Interface - The HCI communication channel for discovery , 2007, Int. J. Hum. Comput. Stud..

[23]  Dieter Schmalstieg,et al.  The invisible train: a collaborative handheld augmented reality demonstrator , 2004, SIGGRAPH '04.

[24]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[25]  Ali Shahrokni,et al.  One-dimensional force feedback slider: going from an analogue to a digital platform , 2006, NordiCHI '06.

[26]  Manfred Tscheligi,et al.  Using emotion in games: emotional flowers , 2007, ACE '07.

[27]  Antonio Krüger,et al.  Sight Quest: A Mobile Game for Paper Maps , 2008, INTETAIN 2008.

[28]  Andreas Butz,et al.  Augmenting buildings with infrared information , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[29]  Marko Topič,et al.  Calibration and data fusion solution for the miniature attitude and heading reference system , 2007 .

[30]  Saul Greenberg,et al.  Multimodal multiplayer tabletop gaming , 2007, CIE.

[31]  Hiroshi Ishii,et al.  Tangible bits: beyond pixels , 2008, TEI.

[32]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface (BBCI) – towards a new communication channel for online control in gaming applications , 2007, Multimedia Tools and Applications.

[33]  Yong Wang,et al.  Using human body gestures as inputs for gaming via depth analysis , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[34]  BERND EISSFELLER,et al.  Performance of GPS , GLONASS and Galileo , 2007 .

[35]  Yunhao Liu,et al.  LANDMARC: Indoor Location Sensing Using Active RFID , 2004, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[36]  Craig Gotsman,et al.  Articulated Object Reconstruction and Markerless Motion Capture from Depth Video , 2008, Comput. Graph. Forum.

[37]  Hiroshi Ishii,et al.  Designing kinetic interactions for organic user interfaces , 2008, CACM.

[38]  Volker Paelke,et al.  Foot-based mobile interaction with games , 2004, ACE '04.

[39]  Sami Laakso,et al.  Design of a body-driven multiplayer game system , 2006, CIE.

[40]  Adrian David Cheok,et al.  Pervasive games: bringing computer entertainment back to the real world , 2005, CIE.

[41]  Ernst Kruijff,et al.  Unconventional human computer interfaces , 2004, SIGGRAPH '04.

[42]  Gerard Jounghyun Kim,et al.  Design and evaluation of a wind display for virtual reality , 2004, VRST '04.

[43]  Ivan Neulander,et al.  Markerless facial motion capture using texture extraction and nonlinear optimization , 2006, SIGGRAPH '06.

[44]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[45]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[46]  Michael Rohs,et al.  Shamus - a Sensor-Based Integrated Mobile phone Instrument , 2007, ICMC.

[47]  Desney S. Tan,et al.  Playing with your brain: brain-computer interfaces and games , 2007, ACE '07.

[48]  Oliver Bimber,et al.  Enabling Mobile Phones To Support Large-Scale Museum Guidance , 2007, IEEE MultiMedia.

[49]  Paul Coulton,et al.  PAC-LAN: mixed-reality gaming with RFID-enabled mobile phones , 2006, CIE.

[50]  Alan F. Blackwell,et al.  Interacting with mobile services: an evaluation of camera-phones and visual tags , 2007, Personal and Ubiquitous Computing.

[51]  Devina Ramduny-Ellis,et al.  The VoodooIO gaming kit: a real-time adaptable gaming controller , 2007, Comput. Entertain..

[52]  G. Yahav,et al.  3D Imaging Camera for Gaming Application , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[53]  Jussi Holopainen,et al.  The Psychophysiology of Video Gaming: Phasic Emotional Responses to Game Events , 2005, DiGRA Conference.

[54]  Masahiko Inami,et al.  Augmented coliseum: an augmented game environment with small vehicles , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[55]  Mark Billinghurst,et al.  User experiences with mobile phone camera game interfaces , 2005, MUM '05.

[56]  Philip Kortum,et al.  HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces , 2008 .

[57]  Michael Nitsche,et al.  Puppet Show : Intuitive Puppet Interfaces for Expressive Character Control , 2006 .

[58]  Toni Robertson,et al.  Labanotation for design of movement-based interaction , 2005 .

[59]  Masahiko Inami,et al.  A teddy-bear-based robotic user interface , 2006, CIE.

[60]  Luca Benini,et al.  Interfacing human and computer with wireless body area sensor networks: the WiMoCA solution , 2008, Multimedia Tools and Applications.

[61]  Christoph Stahl.  The roaring navigator: a group guide for the zoo with shared auditory landmark display , 2007, Mobile HCI.

[62]  Bruce H. Thomas,et al.  Evaluation of user satisfaction and learnability for outdoor augmented reality gaming , 2006, AUIC.

[63]  Gérard Lachapelle.  Pedestrian navigation with high sensitivity GPS receivers and MEMS , 2006, Personal and Ubiquitous Computing.

[65]  Paul Coulton,et al.  Extending cyberspace: location based games using cellular phones , 2006, CIE.