Collaborative brain-computer interfaces for target localisation in rapid serial visual presentation

The N2pc event-related potential appears on the opposite side of the scalp with respect to the visual hemisphere where an object of interest is located. In this paper, we propose a 2-user collaborative brain-computer interface that exploits this component for the automatic localisation of specific lateral targets in real aerial images displayed by means of the rapid serial visual presentation technique at speeds of 5-15 Hz. By combining the evidence from pairs of users using two different methods and with participant selection, we obtain absolute median improvements in the area under the receiver operating characteristic curve of up to 7.7% with respect to single-user BCIs.

[1]  Steven J. Luck,et al.  Electrophysiological Correlates of the Focusing of Attention within Complex Visual Scenes: N2pc and Related ERP Components , 2011 .

[2]  P. Latham,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S11 References Movie S1 Optimally Interacting Minds R�ports , 2022 .

[3]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[4]  Hubert Cecotti,et al.  Performance estimation of a cooperative brain-computer interface based on the detection of steady-state visual evoked potentials , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Christa Neuper,et al.  An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate , 2004, IEEE Transactions on Biomedical Engineering.

[6]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[7]  Peng Yuan,et al.  Study on an online collaborative BCI to accelerate response to visual targets , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Misha Pavel,et al.  Rapid image analysis using neural signals , 2008, CHI Extended Abstracts.

[9]  Kenneth I. Forster,et al.  Visual perception of rapidly presented word sequences of varying complexity , 1970 .

[10]  Tzyy-Ping Jung,et al.  A Collaborative Brain-Computer Interface for Improving Human Performance , 2011, PloS one.

[11]  Riccardo Poli,et al.  Collaborative brain-computer interfaces for the automatic classification of images , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[12]  S J Luck,et al.  Spatial filtering during visual search: evidence from human electrophysiology. , 1994, Journal of experimental psychology. Human perception and performance.

[13]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[14]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[15]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[16]  Stephen Umunna,et al.  Towards a brain computer interface based on the N2pc event-related potential , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[17]  M. Eimer.  The N2pc component as an indicator of attentional selectivity. , 1996, Electroencephalography and clinical neurophysiology.

[18]  Albert B. Kao,et al.  Decision accuracy in complex environments is often maximized by small group sizes , 2014, Proceedings of the Royal Society B: Biological Sciences.

[19]  C. Cinel,et al.  P300-Based BCI Mouse With Genetically-Optimized Analogue Control , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Craig K. Abbey,et al.  Neural decoding of collective wisdom with multi-brain computing , 2012, NeuroImage.

[21]  C. Cinel,et al.  Multi-brain fusion and applications to intelligence analysis , 2013, Defense, Security, and Sensing.

[22]  A. Stoica,et al.  Improving decision-making based on visual perception via a collaborative brain-computer interface , 2013, 2013 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[23]  P. Sajda,et al.  Cortically coupled computer vision for rapid image search , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Tzyy-Ping Jung,et al.  A Collaborative Brain-Computer Interface for Accelerating Human Decision Making , 2013, HCI.

[25]  Alan F. Smeaton,et al.  Curiosity Cloning : Neural Modelling for Image Analysis , Technical Report , 2010 .