I act, therefore I err: EEG correlates of success and failure in a virtual throwing game.

What are the neural responses to success and failure in a throwing task? To answer this question, we compared Event Related Potentials (ERPs) correlated with success and failure during a highly-ecological-virtual game. Participants played a tennis-like game in an immersive 3D virtual world, against a computer player, by controlling a virtual tennis racket with a force feedback robotic arm. Results showed that success, i.e. hitting the target, and failure, by missing the target, evoked ERP's that differ by peak, latencies, scalp signal distributions, sLORETA source estimation, and time-frequency patterns. The success related grand averaged ERP at the Cz electrode, had two peaks - a negative peak at 244ms and a positive peak at 12ms, prior to the actual successful hit, suggesting a possible process of prediction of success. The grand averaged ERP correlated with failure at Cz, had two peaks, a negative peak at about 107ms and a positive peak at about 311ms post failure. These results suggest different top-down and bottom-up loops for success and failure, which seem to be rooted in the spatial arrangement of the virtual game. Although the latency of the latter is consistent with the error related potentials reported in the literature, the characteristic is unique to this specific error, and differ significantly from other error related potentials in the same environment. These results further provide a basis for EEG based assessment and prediction of user's successful or erroneous movements, and design of the feedback loop in EEG based Brain-Computer Interfaces.

[1]  Gert Pfurtscheller,et al.  Controlling a virtual body by thought in a highly-immersive virtual environment - a case study in using a brain-computer interface in a virtual-reality cave-like system , 2007, GRAPP.

[2]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[3]  C. Mehring,et al.  Detection of Error Related Neuronal Responses Recorded by Electrocorticography in Humans during Continuous Movements , 2013, PloS one.

[4]  Paul F. M. J. Verschure,et al.  Differential neural mechanisms for early and late prediction error detection , 2016, Scientific Reports.

[5]  Miriam Reiner,et al.  The role of haptics in immersive telecommunication environments , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Wim Van Paesschen,et al.  Canonical Correlation Analysis Applied to Remove Muscle Artifacts From the Electroencephalogram , 2006, IEEE Transactions on Biomedical Engineering.

[7]  Andreas Schulze-Bonhage,et al.  Error-related electrocorticographic activity in humans during continuous movements , 2012, Journal of neural engineering.

[8]  Clay B. Holroyd,et al.  Electroencephalographic correlates of target and outcome errors , 2008, Experimental Brain Research.

[9]  Miriam Reiner,et al.  Natural stimuli from three coherent modalities enhance behavioral responses and electrophysiological cortical activity in humans. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[10]  Miriam Reiner,et al.  Stroop Interference and Facilitation Effects in Kinesthetic and Haptic Tasks , 2010, Adv. Hum. Comput. Interact..

[11]  Mangesh G. Tuplondhe,et al.  Removal of Ocular Artifacts From electro-Encephalogram by Adaptive Filtering and Independent Component Analysis , 2016 .

[12]  Miriam Reiner,et al.  The Virtual Hand Illusion and Body Ownership , 2008, EuroHaptics.

[13]  D. Mathalon,et al.  Event-related EEG time-frequency analysis: an overview of measures and an analysis of early gamma band phase locking in schizophrenia. , 2008, Schizophrenia bulletin.

[14]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[15]  Lan-Ya Chuang,et al.  The differences in frontal midline theta power between successful and unsuccessful basketball free throws of elite basketball players. , 2013, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[16]  H. Hill,et al.  An event-related potential evoked by movement planning is modulated by performance and learning in visuomotor control , 2009, NeuroImage.

[17]  Heiko Maurer,et al.  Neural correlates of error prediction in a complex motor task , 2015, Front. Behav. Neurosci..

[18]  G. Pourtois,et al.  What is Bottom-Up and What is Top-Down in Predictive Coding? , 2013, Front. Psychol..

[19]  Toshiaki Imada,et al.  Theta brain rhythms index perceptual narrowing in infant speech perception , 2013, Front. Psychol..

[20]  Benoit Bediou,et al.  Delayed monitoring of accuracy errors compared to commission errors in ACC , 2012, NeuroImage.

[21]  Phillip Wolff,et al.  Causal reasoning with forces , 2015, Front. Hum. Neurosci..

[22]  Martin Spüler,et al.  Error-related potentials during continuous feedback: using EEG to detect errors of different type and severity , 2015, Front. Hum. Neurosci..

[23]  Antonio Frisoli,et al.  The contribution of cutaneous and proprioceptive sensory modalities in haptic perception of orientation , 2011 .

[24]  Cheryl L. Dickter,et al.  EEG Methods for the Psychological Sciences , 2013 .

[25]  Yodchanan Wongsawat,et al.  Real-time index for predicting successful golf putting motion using multichannel EEG , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  M. Reiner,et al.  Better than sleep: Theta neurofeedback training accelerates memory consolidation , 2014, Biological Psychology.

[27]  Antonio Frisoli,et al.  The contribution of cutaneous and kinesthetic sensory modalities in haptic perception of orientation , 2011, Brain Research Bulletin.

[28]  M. Reiner,et al.  Perspectives and possible applications of the rubber hand and virtual hand illusion in non-invasive rehabilitation: Technological improvements and their consequences , 2014, Neuroscience & Biobehavioral Reviews.

[29]  O. Jensen,et al.  Shaping Functional Architecture by Oscillatory Alpha Activity: Gating by Inhibition , 2010, Front. Hum. Neurosci..

[30]  S. Makeig Auditory event-related dynamics of the EEG spectrum and effects of exposure to tones. , 1993, Electroencephalography and clinical neurophysiology.

[31]  G. Wilson,et al.  Removal of ocular artifacts from electro-encephalogram by adaptive filtering , 2004, Medical and Biological Engineering and Computing.

[32]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[33]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[34]  Gary H. Glover,et al.  Seeing Shapes and Hearing Textures: Two Neural Categories of Touch , 2011 .

[35]  G. Gomez Automatic Artifact Removal ( AAR ) toolbox v 1 . 3 ( Release 09 . 12 . 2007 ) for MATLAB , 2007 .

[36]  Scott E Kerick,et al.  Independent component analysis of dynamic brain responses during visuomotor adaptation , 2004, NeuroImage.

[37]  Miriam Zacksenhouse,et al.  Brain Responses to Errors During 3D Motion in a Hapto-Visual VR , 2016, EuroHaptics.

[38]  Nadine Eberhardt,et al.  Bioelectrical Signal Processing In Cardiac And Neurological Applications , 2016 .

[39]  Max E. Valentinuzzi,et al.  Artifact removal from EEG signals using adaptive filters in cascade , 2007 .

[40]  M. Lobo,et al.  Shining light on motivation, emotion, and memory processes , 2015, Front. Behav. Neurosci..

[41]  Miriam Reiner,et al.  Neural Correlates of User-initiated Motor Success and Failure – A Brain–Computer Interface Perspective , 2016, Neuroscience.

[42]  Erich Schröger,et al.  Digital filter design for electrophysiological data – a practical approach , 2015, Journal of Neuroscience Methods.

[43]  Kira Padilla,et al.  Visualization: Theory and practice in science education , 2009 .

[44]  Hillel Pratt,et al.  Influence of task-related ipsilateral hand movement on motor cortex excitability , 2001, Clinical Neurophysiology.

[45]  Miriam Reiner,et al.  Seeing Through Touch: The Role of Haptic Information in Visualization , 2008 .

[46]  J. Hohnsbein,et al.  ERP components on reaction errors and their functional significance: a tutorial , 2000, Biological Psychology.

[47]  Miriam Reiner,et al.  Visualization : theory and practice in science education , 2008 .

[48]  Daniel Memmert,et al.  Attentional Mechanisms in Sports Via Brain-Electrical Event-Related Potentials , 2009, Research quarterly for exercise and sport.

[49]  Markus Raab,et al.  Analyzing a complex visuomotor tracking task with brain-electrical event related potentials. , 2005, Human movement science.

[50]  Miriam Reiner,et al.  EEG-based cognitive load of processing events in 3D virtual worlds is lower than processing events in 2D displays. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[51]  Miriam Reiner,et al.  Conceptual Construction of Fields Through Tactile Interface , 1999, Interact. Learn. Environ..

[52]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.