Brain-computer interfaces for 3D games: hype or hope?

Brain-Computer Interfaces (BCI) are communication systems conveying messages through brain activity only. This paper elaborates on the suitability of BCI for 3D Video Games (VG). Thus, we first review some recent BCI-based 3D VG. We then discuss the limitations of current BCI technology, those being mainly related to usability and performances. Finally, we report on some areas in which BCI could be useful for 3D VG despite their limitations. More precisely, BCI could be useful as an additional control channel, to send commands that cannot be intuitively sent with other devices. BCI could also be used for mental state monitoring either 1) during the game, in order to make adaptive and dynamic video games or 2) during the game creation in order to maximizes some measures of game quality that could be derived from a tester's mental state.

[1]  Anatole Lécuyer,et al.  An overview of research on "passive" brain-computer interfaces for implicit human-computer interaction , 2010 .

[2]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface , 2008, WCCI.

[3]  Francisco Velasco-Álvarez,et al.  Free Virtual Navigation Using Motor Imagery Through an Asynchronous BrainComputer Interface , 2010, PRESENCE: Teleoperators and Virtual Environments.

[4]  Anatole Lécuyer,et al.  Exploring Large Virtual Environments by Thoughts Using a BrainComputer Interface Based on Motor Imagery and High-Level Commands , 2010, PRESENCE: Teleoperators and Virtual Environments.

[5]  Cuntai Guan,et al.  Learning from other subjects helps reducing Brain-Computer Interface calibration time , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Dieter Schmalstieg,et al.  An Application Framework for Controlling an Avatar in a Desktop-Based Virtual Environment via a Software SSVEP BrainComputer Interface , 2010, PRESENCE: Teleoperators and Virtual Environments.

[7]  Guillaume Gibert,et al.  OpenViBE: An Open-Source Software Platform to Design, Test, and Use BrainComputer Interfaces in Real and Virtual Environments , 2010, PRESENCE: Teleoperators and Virtual Environments.

[8]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[9]  J.D. Bayliss,et al.  Use of the evoked potential P3 component for control in a virtual apartment , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[11]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[12]  Desney S. Tan,et al.  Brain-Computer Interfaces: Applying our Minds to Human-Computer Interaction , 2010 .

[13]  K. Müller,et al.  Single Trial Classification of Motor Imagination Using 6 Dry EEG Electrodes , 2007, PloS one.

[14]  Michitaka Hirose,et al.  Towards ambulatory brain-computer interfaces: a pilot study with P300 signals , 2009, Advances in Computer Entertainment Technology.

[15]  G. Pfurtscheller,et al.  Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Klaus-Robert Müller,et al.  Subject independent EEG-based BCI decoding , 2009, NIPS.

[17]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[18]  F. Lotte,et al.  Self-Paced Brain-Computer Interaction with Virtual Worlds: A Quantitative and Qualitative Study "Out of the Lab" , 2008 .

[19]  Reinhold Scherer,et al.  Towards self-paced ( asynchronous ) Brain-Computer Communication : Navigation through virtual worlds , 2006 .

[20]  Hideaki Touyama.  Brain-CAVE Interface Based on Steady-State Visual Evoked Potential , 2008 .

[21]  Michitaka Hirose,et al.  Brain-Computer Interfaces, Virtual Reality, and Videogames , 2008, Computer.

[22]  John R. Smith,et al.  Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment , 2005, EURASIP J. Adv. Signal Process..