Classifying Response Correctness across Different Task Sets: A Machine Learning Approach

Erroneous behavior usually elicits a distinct pattern in neural waveforms. In particular, inspection of the concurrent recorded electroencephalograms (EEG) typically reveals a negative potential at fronto-central electrodes shortly following a response error (Ne or ERN) as well as an error-awareness-related positivity (Pe). Seemingly, the brain signal contains information about the occurrence of an error. Assuming a general error evaluation system, the question arises whether this information can be utilized in order to classify behavioral performance within or even across different cognitive tasks. In the present study, a machine learning approach was employed to investigate the outlined issue. Ne as well as Pe were extracted from the single-trial EEG signals of participants conducting a flanker and a mental rotation task and subjected to a machine learning classification scheme (via a support vector machine, SVM). Overall, individual performance in the flanker task was classified more accurately, with accuracy rates of above 85%. Most importantly, it was even feasible to classify responses across both tasks. In particular, an SVM trained on the flanker task could identify erroneous behavior with almost 70% accuracy in the EEG data recorded during the rotation task, and vice versa. Summed up, we replicate that the response-related EEG signal can be used to identify erroneous behavior within a particular task. Going beyond this, it was possible to classify response types across functionally different tasks. Therefore, the outlined methodological approach appears promising with respect to future applications.

[1]  Rolf Verleger,et al.  Spatial S-R Compatibility with Centrally Presented Stimuli: An Event-Related Asymmetry Study on Dimensional Overlap , 1999, Journal of Cognitive Neuroscience.

[2]  D. V. Cramon,et al.  Decision making, performance and outcome monitoring in frontal cortical areas , 2004, Nature Neuroscience.

[3]  T. Sejnowski,et al.  Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects , 2000, Clinical Neurophysiology.

[4]  George K. Matsopoulos,et al.  Classification of Error-Related Negativity (ERN) and Positivity (Pe) potentials using kNN and Support Vector Machines , 2011, Comput. Biol. Medicine.

[5]  M. Herrmann,et al.  Source localization (LORETA) of the error-related-negativity (ERN/Ne) and positivity (Pe). , 2004, Brain research. Cognitive brain research.

[6]  Joshua W. Brown,et al.  Medial prefrontal cortex as an action-outcome predictor , 2011, Nature Neuroscience.

[7]  A. Engel,et al.  Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring , 2005, The Journal of Neuroscience.

[8]  B. Kopp,et al.  N200 in the flanker task as a neurobehavioral tool for investigating executive control. , 1996, Psychophysiology.

[9]  Norbert Kathmann,et al.  Temporospatial dissociation of Pe subcomponents for perceived and unperceived errors , 2012, Front. Hum. Neurosci..

[10]  Ivan Toni,et al.  Neural dynamics of error processing in medial frontal cortex , 2005, NeuroImage.

[11]  Norbert Kathmann,et al.  Response-related negativities following correct and incorrect responses: evidence from a temporospatial principal component analysis. , 2012, Psychophysiology.

[12]  J. Hohnsbein,et al.  Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. , 1991, Electroencephalography and clinical neurophysiology.

[13]  Herbert Heuer,et al.  Different error types and error processing in spatial stimulus-response-compatibility tasks: behavioural and electrophysiological data , 2000, Biological Psychology.

[14]  J. Hohnsbein,et al.  ERP components on reaction errors and their functional significance: a tutorial , 2000, Biological Psychology.

[15]  Sven Hoffmann,et al.  Spatial cueing modulates the monitoring of correct responses , 2012, Neuroscience Letters.

[16]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[17]  Hilde T. Juvodden,et al.  Mal-Adaptation of Event-Related EEG Responses Preceding Performance Errors , 2010, Front. Hum. Neurosci..

[18]  Christian Beste,et al.  Crosslinking EEG time–frequency decomposition and fMRI in error monitoring , 2013, Brain Structure and Function.

[19]  Bhaskar D. Rao,et al.  Modeling and Estimation of Dependent Subspaces with Non-radially Symmetric and Skewed Densities , 2007, ICA.

[20]  Thérèse J. M. Overbeek,et al.  Dissociable Components of Error Processing on the Functional Significance of the Pe Vis-à-vis the Ern/ne Performance Monitoring Processes Reflected in the Ne and Pe Review of Studies That Report Both Ne and Pe: Associations and Dissociations Pharmacological Effects , 2022 .

[21]  B. Burle,et al.  Error negativity on correct trials: a reexamination of available data , 2003, Biological Psychology.

[22]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[23]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[24]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[25]  Hideaki Tanaka,et al.  Error-related brain potentials elicited by vocal errors , 2001, Neuroreport.

[26]  Norbert Kathmann,et al.  Neural correlates of error awareness , 2007, NeuroImage.

[27]  J. Hohnsbein,et al.  Central and parietal event-related lateralizations in a flanker task. , 2004, Psychophysiology.

[28]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[29]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[30]  K. R. Ridderinkhof,et al.  Error-related brain potentials are differentially related to awareness of response errors: evidence from an antisaccade task. , 2001, Psychophysiology.

[31]  R. Oostenveld,et al.  Independent EEG Sources Are Dipolar , 2012, PloS one.

[32]  Sven Hoffmann,et al.  Personality and error monitoring: an update , 2012, Front. Hum. Neurosci..

[33]  Sven Hoffmann,et al.  Predictive information processing in the brain: errors and response monitoring. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[34]  Borís Burle,et al.  Rostral Cingulate Zone and correct response monitoring: ICA and source localization evidences for the unicity of correct- and error-negativities , 2010, NeuroImage.

[35]  Michael Falkenstein,et al.  Independent component analysis of erroneous and correct responses suggests online response control , 2010, Human brain mapping.

[36]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[37]  Aapo Hyvärinen,et al.  Learning Natural Image Structure with a Horizontal Product Model , 2009, ICA.

[38]  Stefan Bode,et al.  Similar neural mechanisms for perceptual guesses and free decisions , 2013, NeuroImage.

[39]  D. Yves von Cramon,et al.  Neuroimaging of Performance Monitoring: Error Detection and Beyond , 2004, Cortex.

[40]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[41]  Greg Hajcak,et al.  The stability of error-related brain activity with increasing trials. , 2009, Psychophysiology.

[42]  Sayan Mukherjee,et al.  Permutation Tests for Classification , 2005, COLT.

[43]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[44]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[45]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[46]  John J. Foxe,et al.  Uncovering the Neural Signature of Lapsing Attention: Electrophysiological Signals Predict Errors up to 20 s before They Occur , 2009, The Journal of Neuroscience.

[47]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[48]  Marco Steinhauser,et al.  Error-related brain activity and adjustments of selective attention following errors , 2011, NeuroImage.

[49]  Gemma C. Garriga,et al.  Permutation Tests for Studying Classifier Performance , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[50]  Christian Beste,et al.  A perspective on neural and cognitive mechanisms of error commission , 2015, Front. Behav. Neurosci..

[51]  M G Coles,et al.  A brain potential manifestation of error-related processing. , 1995, Electroencephalography and clinical neurophysiology. Supplement.

[52]  Barak A. Pearlmutter,et al.  Linear Spatial Integration for Single-Trial Detection in Encephalography , 2002, NeuroImage.

[53]  N. Yeung,et al.  Decision Processes in Human Performance Monitoring , 2010, The Journal of Neuroscience.

[54]  K. R. Ridderinkhof,et al.  Neurocognitive mechanisms of cognitive control: The role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning , 2004, Brain and Cognition.

[55]  F. Vidal,et al.  Is the ‘error negativity’ specific to errors? , 2000, Biological Psychology.

[56]  G. Band,et al.  Age effects on response monitoring in a mental-rotation task , 2000, Biological Psychology.

[57]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[58]  Terrence J. Sejnowski,et al.  Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis , 2007, NeuroImage.

[59]  V. Michel,et al.  Recruitment of an Area Involved in Eye Movements During Mental Arithmetic , 2009, Science.

[60]  N. Yeung,et al.  Dissociable correlates of response conflict and error awareness in error-related brain activity , 2011, Neuropsychologia.

[61]  Tom Eichele,et al.  Error-preceding brain activity reflects (mal-)adaptive adjustments of cognitive control: a modeling study , 2012, Front. Hum. Neurosci..

[62]  Anna Weinberg,et al.  Biological Psychology , 2022 .