A neuro-based method for detecting context-dependent erroneous robot action

Validating appropriateness and naturalness of human-robot interaction (HRI) is commonly performed by taking subjective measures from human interaction partners, e.g. questionnaire ratings. Although these measures can be of high value for robot designers, they are very sensitive and can be inaccurate and/or biased. In this paper we propose and validate a neuro-based method for objectively validating robot behavior in HRI. We propose to detect from the electronencephalo-gram (EEG) of a human interaction partner, the perception of inappropriate / unexpected / erroneous robot behavior. To validate this method, we conducted an EEG experiment with a simplified HRI protocol in which a humanoid robot displayed context-dependent erroneous behavior from time to time. The EEG data taken from 13 participants revealed biologically plausible error-related potentials (ErrP) whose spatio-temporal distributions match well with related neuroscientific research. We further demonstrate that perceived erroneous robot action can reliably be modeled and detected from human EEG signals with classification accuracies on avg. 69.7±9.1%. These findings confirm principal feasibility of the proposed method and suggest that EEG-based ErrP detection can be used for quantitative evaluation and thus improvement of robot behavior.

[1]  Pierre Blazevic,et al.  The NAO humanoid: a combination of performance and affordability , 2008, ArXiv.

[2]  Jean Scholtz,et al.  Common metrics for human-robot interaction , 2006, HRI '06.

[3]  Rafal Bogacz,et al.  Theta phase resetting and the error-related negativity. , 2007, Psychophysiology.

[4]  Agnieszka Wykowska,et al.  When to engage in interaction — And how? EEG-based enhancement of robot's ability to sense social signals in HRI , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[5]  Martin Spüler,et al.  Error-related potentials during continuous feedback: using EEG to detect errors of different type and severity , 2015, Front. Hum. Neurosci..

[6]  Markus Ullsperger,et al.  Event-Related Potential Correlates of Performance-Monitoring in a Lateralized Time-Estimation Task , 2011, PloS one.

[7]  Vicenç Gómez,et al.  On the use of interaction error potentials for adaptive brain computer interfaces , 2011, Neural Networks.

[8]  H. Bekkering,et al.  Modulation of activity in medial frontal and motor cortices during error observation , 2004, Nature Neuroscience.

[9]  J. Friedman Regularized Discriminant Analysis , 1989 .

[10]  Iñaki Iturrate,et al.  Asynchronous detection of error potentials , 2014 .

[11]  Michael Falkenstein,et al.  Classifying Response Correctness across Different Task Sets: A Machine Learning Approach , 2016, PloS one.

[12]  José del R. Millán,et al.  Error-Related EEG Potentials Generated During Simulated Brain–Computer Interaction , 2008, IEEE Transactions on Biomedical Engineering.

[13]  L. Osterhout,et al.  The independence of combinatory semantic processing: Evidence from event-related potentials , 2005 .

[14]  R Chavarriaga,et al.  Learning From EEG Error-Related Potentials in Noninvasive Brain-Computer Interfaces , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Ricardo Chavarriaga,et al.  Teaching brain-machine interfaces as an alternative paradigm to neuroprosthetics control , 2015, Scientific Reports.

[16]  M. Ullsperger,et al.  Neurophysiology of performance monitoring and adaptive behavior. , 2014, Physiological reviews.

[17]  G. Pfurtscheller,et al.  A fully automated correction method of EOG artifacts in EEG recordings , 2007, Clinical Neurophysiology.

[18]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[19]  J. Hohnsbein,et al.  ERP components on reaction errors and their functional significance: a tutorial , 2000, Biological Psychology.