Augmenting group performance in target-face recognition via collaborative brain-computer interfaces for surveillance applications

This paper presents a hybrid collaborative brain-computer interface (cBCI) to improve group-based recognition of target faces in crowded scenes recorded from surveillance cameras. The cBCI uses a combination of neural features extracted from EEG and response times to estimate the decision confidence of the users. Group decisions are then obtained by weighing individual responses according to these confidence estimates. Results obtained with 10 participants indicate that the proposed cBCI improves decision errors by up to 7% over traditional group decisions based on majority. Moreover, the confidence estimates obtained by the cBCI are more accurate and robust than the confidence reported by the participants after each decision. These results show that cBCIs can be an effective means of human augmentation in realistic scenarios.

[1]  Paul W. Paese,et al.  Decisions, actions, and the appropriateness of confidence in knowledge , 1991 .

[2]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[3]  Yiwen Wang,et al.  A rapid face recognition BCI system using single-trial ERP , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[4]  John A. Pyles,et al.  Dynamic Encoding of Face Information in the Human Fusiform Gyrus , 2014, Nature Communications.

[5]  Rui Zhang,et al.  Local Temporal Correlation Common Spatial Patterns for Single Trial EEG Classification during Motor Imagery , 2013, Comput. Math. Methods Medicine.

[6]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[7]  A. Cichocki,et al.  A novel BCI based on ERP components sensitive to configural processing of human faces , 2012, Journal of neural engineering.

[8]  Agustin Lage-Castellanos,et al.  A zero-training algorithm for EEG single-trial classification applied to a face recognition ERP experiment , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[9]  Zhi-Hua Zhou,et al.  Face recognition from a single image per person: A survey , 2006, Pattern Recognit..

[10]  Riccardo Poli,et al.  A collaborative Brain-Computer Interface for improving group detection of visual targets in complex natural environments , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[11]  Bahador Bahrami,et al.  Post-decisional accounts of biases in confidence , 2016, Current Opinion in Behavioral Sciences.

[12]  Riccardo Poli,et al.  Enhancement of Group Perception via a Collaborative Brain–Computer Interface , 2017, IEEE Transactions on Biomedical Engineering.

[13]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[14]  James W. Tanaka,et al.  Activation of Preexisting and Acquired Face Representations: The N250 Event-related Potential as an Index of Face Familiarity , 2006, Journal of Cognitive Neuroscience.

[15]  Weidong Chen,et al.  Rapid face recognition based on single-trial event-related potential detection over multiple brains , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[16]  Yongkang Wong,et al.  Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition , 2011, CVPR 2011 WORKSHOPS.