Single trial recognition of error-related potentials during observation of robot operation

Recent works suggest that several human cognitive processes elicited during the observation and monitoring of tasks developed by others can be detected in real time. These works have also demonstrated that human brain activity can be used to recover from machine errors, and as reward signals to teach a simulated robot how to perform given tasks. This paper studies the elicitation of this activity during the operation of a real robot. Experimental results have been obtained with 4 participants observing the operation of a 5 d.o.f. robotic arm performing correct/incorrect reaching tasks, while an EEG system recorded their brain activity. The results give evidence that the brain areas that play a role in detection and monitoring of errors also play a role when observing the operation of a real robot, that a brain discriminative response is elicited during the observation of a correct/incorrect operation of a real robot, and that it is possible to learn a classifier that provides online categorization with high accuracy (80%).

[1]  A. Nobre,et al.  The Large-Scale Neural Network for Spatial Attention Displays Multifunctional Overlap But Differential Asymmetry , 1999, NeuroImage.

[2]  J. Hohnsbein,et al.  ERP components on reaction errors and their functional significance: a tutorial , 2000, Biological Psychology.

[3]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[4]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[5]  H. Bekkering,et al.  Modulation of activity in medial frontal and motor cortices during error observation , 2004, Nature Neuroscience.

[6]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[7]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[8]  J. Millán,et al.  Error-related EEG potentials in brain-computer interfaces , 2007 .

[9]  M. Matteucci,et al.  Automatic Recognition of Error Potentials in a P300-Based Brain-Computer Interface , 2008 .

[10]  José del R. Millán,et al.  Simultaneous Real-Time Detection of Motor Imagery and Error-Related Potentials for Improved BCI Accuracy , 2008 .

[11]  Iñaki Iturrate,et al.  Robot reinforcement learning using EEG-based reward signals , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.