Learning From EEG Error-Related Potentials in Noninvasive Brain-Computer Interfaces

We describe error-related potentials generated while a human user monitors the performance of an external agent and discuss their use for a new type of brain-computer interaction. In this approach, single trial detection of error-related electroencephalography (EEG) potentials is used to infer the optimal agent behavior by decreasing the probability of agent decisions that elicited such potentials. Contrasting with traditional approaches, the user acts as a critic of an external autonomous system instead of continuously generating control commands. This sets a cognitive monitoring loop where the human directly provides information about the overall system performance that, in turn, can be used for its improvement. We show that it is possible to recognize erroneous and correct agent decisions from EEG (average recognition rates of 75.8% and 63.2%, respectively), and that the elicited signals are stable over long periods of time (from 50 to > 600 days). Moreover, these performances allow to infer the optimal behavior of a simple agent in a brain-computer interaction paradigm after a few trials.

[1]  José del R. Millán,et al.  Context-Based Filtering for Assisted Brain-Actuated Wheelchair Driving , 2007, Comput. Intell. Neurosci..

[2]  Kai-Quan Shen,et al.  EEG-based mental fatigue measurement using multi-class support vector machines with confidence estimate , 2008, Clinical Neurophysiology.

[3]  Roland Siegwart,et al.  A comparative psychophysical and EEG study of different feedback modalities for HRI , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  G. Pfurtscheller,et al.  EEG-based communication: presence of an error potential , 2000, Clinical Neurophysiology.

[5]  Thorsten O. Zander,et al.  Utilizing Secondary Input from Passive Brain-Computer Interfaces for Enhancing Human-Machine Interaction , 2009, HCI.

[6]  Katja Fiehler,et al.  Electrophysiological correlates of error correction. , 2005, Psychophysiology.

[7]  José del R. Millán,et al.  Improving Human Performance in a Real Operating Environment through Real-Time Mental Workload Detection , 2007 .

[8]  H. Bekkering,et al.  Modulation of activity in medial frontal and motor cortices during error observation , 2004, Nature Neuroscience.

[9]  K.-R. Muller,et al.  Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Desney S. Tan,et al.  Human-aided computing: utilizing implicit human processing to classify images , 2008, CHI.

[11]  Ricardo Chavarriaga,et al.  Fast Recognition of Anticipation-Related Potentials , 2009, IEEE Transactions on Biomedical Engineering.

[12]  J. Hohnsbein,et al.  ERP components on reaction errors and their functional significance: a tutorial , 2000, Biological Psychology.

[13]  J. Millán,et al.  Error-related EEG potentials in brain-computer interfaces , 2007 .

[14]  P. Sajda,et al.  Response error correction-a demonstration of improved human-machine performance using real-time EEG monitoring , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[16]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[17]  Roland Siegwart,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Brain-coupled Interaction for Semi-autonomous Navigation of an Assistive Robot , 2022 .

[18]  A. Engel,et al.  Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring , 2005, The Journal of Neuroscience.

[19]  Ricardo Chavarriaga,et al.  To Err Is Human: Learning from Error Potentials in Brain-Computer Interfaces , 2007 .

[20]  José del R. Millán,et al.  Error-Related EEG Potentials Generated During Simulated Brain–Computer Interaction , 2008, IEEE Transactions on Biomedical Engineering.

[21]  P. Dayan,et al.  Reward, Motivation, and Reinforcement Learning , 2002, Neuron.

[22]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[23]  Michael J. Frank,et al.  Error-Related Negativity Predicts Reinforcement Learning and Conflict Biases , 2005, Neuron.

[24]  J. J. Lange,et al.  Color selection and location selection in ERPs: differences, similarities and `neural specificity' , 1998, Biological Psychology.

[25]  Michael X. Cohen,et al.  Reward expectation modulates feedback-related negativity and EEG spectra , 2007, NeuroImage.

[26]  Xavier Perrin,et al.  Semi-autonomous navigation of an assistive robot using low throughput interfaces , 2009 .

[27]  Jonathan R. Folstein,et al.  Novelty and conflict in the categorization of complex stimuli. , 2008, Psychophysiology.

[28]  Sidney J Segalowitz,et al.  Development of Response-Monitoring ERPs in 7- to 25-Year-Olds , 2004, Developmental neuropsychology.

[29]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[30]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[31]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[32]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[33]  J. Hohnsbein,et al.  Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. , 1991, Electroencephalography and clinical neurophysiology.

[34]  P. Rabbitt.  Errors and error correction in choice-response tasks. , 1966, Journal of experimental psychology.

[35]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[36]  José del R. Millán,et al.  You Are Wrong! - Automatic Detection of Interaction Errors from Brain Waves , 2005, IJCAI.

[37]  W. Gehring,et al.  Neural Systems for Error Monitoring , 2007, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[38]  Clay B. Holroyd,et al.  A note on the oddball N200 and the feedback ERN , 2004 .