Collaborative brain-computer interfaces for the automatic classification of images

In this paper, we propose a collaborative brain-computer interface for the automatic discrimination of images containing specific targets. When a user looks at a stream of images that are displayed using the rapid serial visual presentation protocol, images containing targets elicit a P300 event-related potential that can be detected. This allows the images to be automatically labelled as targets and non-targets. While this is relatively unreliable with single users, by combining the evidence from groups of users, we obtained relative median improvements in the accuracy (assessed by the area under the receiver operating characteristic curve) of 8.2% and 14.3% for groups of 2 and 3 users, respectively.

[1]  Deepak Khosla,et al.  A low-bandwidth graphical user interface for high-speed triage of potential items of interest in video imagery , 2013, Defense, Security, and Sensing.

[2]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[3]  C. Cinel,et al.  Multi-brain fusion and applications to intelligence analysis , 2013, Defense, Security, and Sensing.

[4]  A. Stoica,et al.  Improving decision-making based on visual perception via a collaborative brain-computer interface , 2013, 2013 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[5]  Kenneth I. Forster,et al.  Visual perception of rapidly presented word sequences of varying complexity , 1970 .

[6]  Tzyy-Ping Jung,et al.  A Collaborative Brain-Computer Interface for Improving Human Performance , 2011, PloS one.

[7]  P. Sajda,et al.  Cortically coupled computer vision for rapid image search , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  C. Koch,et al.  The duration of the attentional blink in natural scenes depends on stimulus category , 2007, Vision Research.

[9]  Alan F. Smeaton,et al.  Curiosity Cloning : Neural Modelling for Image Analysis , Technical Report , 2010 .

[10]  M. Potter,et al.  Recognition memory for a rapid sequence of pictures. , 1969, Journal of experimental psychology.

[11]  Jonathan R Wolpaw,et al.  Brain–computer interface systems: progress and prospects , 2007, Expert review of medical devices.

[12]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[13]  Peng Yuan,et al.  Study on an online collaborative BCI to accelerate response to visual targets , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  David Windridge,et al.  High throughput screening for mammography using a human-computer interface with rapid serial visual presentation (RSVP) , 2013, Medical Imaging.

[15]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.