Author manuscript, published in "IEEE Transactions on Computational Intelligence and AI in games (2013)" Two Brains, One Game: Design and Evaluation of a Multi-User BCI Video Game Based on Motor Imagery

How can we connect two brains to a video game by means of a brain-computer interface (BCI), and what will happen when we do so? How will the two users behave, and how will they perceive this novel common experience? In this paper, we are concerned with the design and evaluation of multiuser BCI applications. We created a multiuser videogame called BrainArena in which two users can play a simple football game by means of two BCIs. They can score goals on the left or right side of the screen by simply imagining left or right hand movements. To add another interesting element, the gamers can play in a collaborative manner (their two mental activities are combined to score in the same goal), or in a competitive manner (the gamers must push the ball in opposite directions). Two experiments were conducted to evaluate the performance and subjective experience of users in the different conditions. In the first experiment, we compared a single-user situation with one multiuser situation: the collaborative task. Experiment 1 showed that multiuser conditions are significantly preferred, in terms of fun and motivation, compared to the single-user condition. The performance of some users was even significantly improved in the multiuser condition. A subset of well-performing subjects was involved in the second experiment, where we added the competitive task. Experiment 2 suggested that competitive and collaborative conditions may lead to similar performances and motivations. However, the corresponding gaming experiences can be perceived differently among the participants. Taken together our results suggest that multiuser BCI applications can be operational, effective, and more engaging for participants.

[1]  G. Pfurtscheller,et al.  Graz-BCI: state of the art and clinical applications , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Anton Nijholt,et al.  Social Interaction in a Cooperative Brain-Computer Interface Game , 2011, INTETAIN.

[3]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[4]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[5]  R. Burke,et al.  Brain Computer Interface based on the Steady-State VEP for Immersive Gaming Control , 2004 .

[6]  Anton Nijholt,et al.  A Study in User-Centered Design and Evaluation of Mental Tasks for BCI , 2011, MMM.

[7]  A. Kübler,et al.  Motivation modulates the P300 amplitude during brain–computer interface use , 2010, Clinical Neurophysiology.

[8]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[9]  D. Harrison,et al.  Time, Teams, and Task Performance: Changing Effects of Surface- and Deep-Level Diversity on Group Functioning , 2002 .

[10]  Nancy J. Cooke,et al.  On Teams, Teamwork, and Team Performance: Discoveries and Developments , 2008, Hum. Factors.

[11]  F. Cincotti,et al.  Neuroelectrical Hyperscanning Measures Simultaneous Brain Activity in Humans , 2010, Brain Topography.

[12]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[13]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[14]  M. Grosse-Wentrup,et al.  Biased feedback in brain-computer interfaces , 2010, Journal of NeuroEngineering and Rehabilitation.

[15]  Fabien Lotte,et al.  Brain-computer interfaces for 3D games: hype or hope? , 2011, FDG.

[16]  Guillaume Gibert,et al.  OpenViBE: An Open-Source Software Platform to Design, Test, and Use BrainComputer Interfaces in Real and Virtual Environments , 2010, PRESENCE: Teleoperators and Virtual Environments.

[17]  N. Birbaumer,et al.  The Influence of Psychological State and Motivation on Brain–Computer Interface Performance in Patients with Amyotrophic Lateral Sclerosis – a Longitudinal Study , 2010, Front. Neuropharma..

[18]  Michitaka Hirose,et al.  Brain-Computer Interfaces, Virtual Reality, and Videogames , 2008, Computer.

[19]  John R. Smith,et al.  Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment , 2005, EURASIP J. Adv. Signal Process..

[20]  Anton Nijholt.  Towards Multimodal, Multi-party, and Social Brain-Computer Interfacing , 2011, INTETAIN.

[21]  F. Lotte,et al.  Self-Paced Brain-Computer Interaction with Virtual Worlds: A Quantitative and Qualitative Study "Out of the Lab" , 2008 .

[22]  Antinus Nijholt,et al.  User Experience Evaluation in BCI: Mind the Gap! , 2011 .

[23]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[24]  Anatole Lécuyer,et al.  An overview of research on "passive" brain-computer interfaces for implicit human-computer interaction , 2010 .

[25]  Dirk Heylen,et al.  Bacteria Hunt: A multimodal, multiparadigm BCI game , 2010 .

[26]  Janice S. Aikins.  Out of the Lab , 1993, IEEE Expert.

[27]  Christa Neuper,et al.  Neurofeedback Training for BCI Control , 2009 .

[28]  Dirk Heylen,et al.  Brain-Computer Interfacing and Games , 2010, Brain-Computer Interfaces.

[29]  Ricardo Ron-Angevin,et al.  Brain–computer interface: Changes in performance using virtual reality techniques , 2009, Neuroscience Letters.

[30]  G. Pfurtscheller,et al.  Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[32]  Laura Astolfi,et al.  Defecting or Not Defecting: How to “Read” Human Behavior during Cooperative Games by EEG Measurements , 2010, PloS one.

[33]  Anton Nijholt,et al.  Perspectives on User Experience Evaluation of Brain-Computer Interfaces , 2011, HCI.

[34]  Benjamin Blankertz,et al.  A Note on Brain Actuated Spelling with the Berlin Brain-Computer Interface , 2007, HCI.

[35]  Gert Pfurtscheller,et al.  Characterization of four-class motor imagery EEG data for the BCI-competition 2005 , 2005, Journal of neural engineering.

[36]  D. McFarland,et al.  An auditory brain–computer interface (BCI) , 2008, Journal of Neuroscience Methods.

[37]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[38]  G. Pfurtscheller,et al.  Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. , 2005, Brain research. Cognitive brain research.

[39]  Brendan Z. Allison,et al.  New input modalities for modern game design and virtual embodiment , 2012, 2012 IEEE Virtual Reality Workshops (VRW).