Past and Future of Multi-Mind Brain-Computer Interfaces

The great improvements in brain–computer interface (BCI) performance that are brought upon by merging brain activity from multiple users have made this a popular strategy that allows even for human augmentation. These multi-mind BCIs have contributed in changing the role of BCIs from assistive technologies for people with disabilities into tools for human enhancement. This chapter reviews the history of multi-mind BCIs that have their root in the hyperscanning technique; the collaborative and competitive approaches; and the different ways that exist to integrate the brain signals from multiple people and optimally form groups to maximize performance. The main applications of multi-mind BCIs, including control of external devices, entertainment, and decision making, are also surveyed and discussed, in order to help the reader understand what are the most promising avenues and find the gaps that are worthy of future exploration. The chapter also provides a step-by-step tutorial to the design and implementation of a multi-mind BCI, with theoretical guidelines and a sample application.

[1]  Riccardo Poli,et al.  Collaborative brain-computer interfaces for target localisation in rapid serial visual presentation , 2014, 2014 6th Computer Science and Electronic Engineering Conference (CEEC).

[2]  Raúl Rojas,et al.  Semi-autonomous Car Control Using Brain Computer Interfaces , 2012, IAS.

[3]  F. Babiloni,et al.  The Estimation of Cortical Activity for Brain-Computer Interface: Applications in a Domotic Context , 2007, Comput. Intell. Neurosci..

[4]  Sara Ilstedt Hjelm,et al.  Brainball - using brain activity for cool competition , 2000 .

[5]  Tzyy-Ping Jung,et al.  A Collaborative Brain-Computer Interface for Improving Human Performance , 2011, PloS one.

[6]  Aleksandra Vuckovic,et al.  Competitive and Collaborative Multiuser BCI , 2016 .

[7]  A. Stoica,et al.  Improving decision-making based on visual perception via a collaborative brain-computer interface , 2013, 2013 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[8]  Chang Soo Nam,et al.  Brain-computer interface supported collaborative work: Implications for rehabilitation , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Craig K. Abbey,et al.  Neural decoding of collective wisdom with multi-brain computing , 2012, NeuroImage.

[10]  Frank E. Pollick,et al.  A Wireless Future: performance art, interaction and the brain-computer interfaces , 2014 .

[11]  Janet S Fulton,et al.  The space between us. , 2009, Clinical nurse specialist CNS.

[12]  Anton Nijholt,et al.  Multi-Brain BCI: Characteristics and Social Interactions , 2016, HCI.

[13]  C. Cinel,et al.  Multi-brain fusion and applications to intelligence analysis , 2013, Defense, Security, and Sensing.

[14]  Laura Astolfi,et al.  Defecting or Not Defecting: How to “Read” Human Behavior during Cooperative Games by EEG Measurements , 2010, PloS one.

[15]  Riccardo Poli,et al.  Brain–Computer Interfaces for Detection and Localization of Targets in Aerial Images , 2017, IEEE Transactions on Biomedical Engineering.

[16]  Riccardo Poli,et al.  Collaborative Brain-Computer Interface for Aiding Decision-Making , 2014, PloS one.

[17]  Jônatas Manzolli,et al.  Disembodied and Collaborative Musical Interaction in the Multimodal Brain Orchestra , 2010, NIME.

[18]  Dirk Heylen,et al.  Brain-Computer Interfacing and Games , 2010, Brain-Computer Interfaces.

[19]  Vince D. Calhoun,et al.  Cortical Response Similarities Predict which Audiovisual Clips Individuals Viewed, but Are Unrelated to Clip Preference , 2015, PloS one.

[20]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[21]  Riccardo Poli,et al.  Event-Related Potentials induced by cuts in feature movies and their exploitation for understanding cut efficacy , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[22]  Riccardo Poli,et al.  Collaborative brain-computer interfaces for the automatic classification of images , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[23]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[24]  Riccardo Poli,et al.  Group Augmentation in Realistic Visual-Search Decisions via a Hybrid Brain-Computer Interface , 2017, Scientific Reports.

[25]  Riccardo Poli,et al.  Towards cooperative brain-computer interfaces for space navigation , 2013, IUI '13.

[26]  Richard A. Andersen,et al.  A collaborative BCI approach to autonomous control of a prosthetic limb system , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[27]  Tzyy-Ping Jung,et al.  A collaborative brain-computer interface , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[28]  Tzyy-Ping Jung,et al.  A Collaborative Brain-Computer Interface for Accelerating Human Decision Making , 2013, HCI.

[29]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[30]  Peng Yuan,et al.  Study on an online collaborative BCI to accelerate response to visual targets , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Riccardo Poli,et al.  Towards the automated localisation of targets in rapid image-sifting by collaborative brain-computer interfaces , 2017, PloS one.

[32]  C. Cinel,et al.  P300-Based BCI Mouse With Genetically-Optimized Analogue Control , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Yueqing Li,et al.  Collaborative Brain-Computer Interface for People with Motor Disabilities [Research Frontier] , 2016, IEEE Computational Intelligence Magazine.

[34]  F. Cincotti,et al.  Neuroelectrical Hyperscanning Measures Simultaneous Brain Activity in Humans , 2010, Brain Topography.

[35]  Riccardo Poli,et al.  Enhancement of Group Perception via a Collaborative Brain–Computer Interface , 2017, IEEE Transactions on Biomedical Engineering.

[36]  Anton Nijholt,et al.  Experiencing BCI Control in a Popular Computer Game , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[37]  Anton Nijholt,et al.  Social Interaction in a Cooperative Brain-Computer Interface Game , 2011, INTETAIN.

[38]  Liqing Zhang,et al.  A competitive brain computer interface: Multi-person car racing system , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[39]  Christian Jutten,et al.  Single-trial classification of multi-user P300-based Brain-Computer Interface using riemannian geometry , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[40]  Hubert Cecotti,et al.  Performance estimation of a cooperative brain-computer interface based on the detection of steady-state visual evoked potentials , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[41]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[42]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[43]  Fabien Lotte,et al.  Brain-Computer Interfaces: Beyond Medical Applications , 2012, Computer.

[44]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[45]  G. Vanacker,et al.  Adaptive Shared Control of a Brain-Actuated Simulated Wheelchair , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[46]  Febo Cincotti,et al.  Tools for Brain-Computer Interaction: A General Concept for a Hybrid BCI , 2011, Front. Neuroinform..

[47]  Weidong Chen,et al.  Rapid face recognition based on single-trial event-related potential detection over multiple brains , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[48]  D. Heeger,et al.  Neurocinematics: The Neuroscience of Film , 2008 .

[49]  Damien Coyle,et al.  Games, Gameplay, and BCI: The State of the Art , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[50]  Anatole Lécuyer,et al.  Author manuscript, published in "IEEE Transactions on Computational Intelligence and AI in games (2013)" Two Brains, One Game: Design and Evaluation of a Multi-User BCI Video Game Based on Motor Imagery , 2022 .

[51]  Brendan Z. Allison,et al.  Toward Multi-brain Communication: Collaborative Spelling with a P300 BCI , 2014, HCI.

[52]  Ahmed Kattan,et al.  Two Brains Guided Interactive Evolution , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[53]  Eduardo Miranda,et al.  Guide to Brain-Computer Music Interfacing , 2014, Springer London.

[54]  N. Kerr,et al.  Group performance and decision making. , 2004, Annual review of psychology.

[55]  L. Astolfi,et al.  Social neuroscience and hyperscanning techniques: Past, present and future , 2014, Neuroscience & Biobehavioral Reviews.

[56]  Anton Nijholt.  Competing and Collaborating Brains: Multi-brain Computer Interfacing , 2015, Brain-Computer Interfaces.

[57]  G Townsend,et al.  Pushing the P300-based brain-computer interface beyond 100 bpm: extending performance guided constraints into the temporal domain. , 2016, Journal of neural engineering.

[58]  Riccardo Poli,et al.  A collaborative Brain-Computer Interface for improving group detection of visual targets in complex natural environments , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[59]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[60]  Riccardo Poli,et al.  Augmenting group performance in target-face recognition via collaborative brain-computer interfaces for surveillance applications , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[61]  T. D. Duane,et al.  Extrasensory Electroencephalographic Induction between Identical Twins , 1965, Science.