Utilizing sensory prediction errors for movement intention decoding: A new methodology

A new high-accuracy movement intention decoder using <100 ms of EEG and requiring no training or cognitive loading of users. We propose a new methodology for decoding movement intentions of humans. This methodology is motivated by the well-documented ability of the brain to predict sensory outcomes of self-generated and imagined actions using so-called forward models. We propose to subliminally stimulate the sensory modality corresponding to a user’s intended movement, and decode a user’s movement intention from his electroencephalography (EEG), by decoding for prediction errors—whether the sensory prediction corresponding to a user’s intended movement matches the subliminal sensory stimulation we induce. We tested our proposal in a binary wheelchair turning task in which users thought of turning their wheelchair either left or right. We stimulated their vestibular system subliminally, toward either the left or the right direction, using a galvanic vestibular stimulator and show that the decoding for prediction errors from the EEG can radically improve movement intention decoding performance. We observed an 87.2% median single-trial decoding accuracy across tested participants, with zero user training, within 96 ms of the stimulation, and with no additional cognitive load on the users because the stimulation was subliminal.

[1]  Louise O'hare Steady‐state VEP responses to uncomfortable stimuli , 2017, The European journal of neuroscience.

[2]  Mads Jochumsen,et al.  A Review of Techniques for Detection of Movement Intention Using Movement-Related Cortical Potentials , 2015, Comput. Math. Methods Medicine.

[3]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  I. Keller,et al.  Subliminal galvanic-vestibular stimulation recalibrates the distorted visual and tactile subjective vertical in right-sided stroke , 2015, Neuropsychologia.

[5]  Hideyuki Ando,et al.  Virtual acceleration with galvanic vestibular stimulation in a virtual reality environment , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[6]  Erich Schröger,et al.  I know what is missing here: electrophysiological prediction error signals elicited by omissions of predicted ”what” but not ”when” , 2013, Front. Hum. Neurosci..

[7]  Mitsuo Kawato,et al.  Physically interacting individuals estimate the partner’s goal to enhance their movements , 2017, Nature Human Behaviour.

[8]  Gowrishankar Ganesh,et al.  Watching novice action degrades expert motor performance: Causation between action production and outcome prediction of observed actions by humans , 2014, Scientific Reports.

[9]  Gowrishankar Ganesh,et al.  Shared Mechanisms in the Estimation of Self-Generated Actions and the Prediction of Other’s Actions by Humans , 2017, eNeuro.

[10]  Dario Farina,et al.  Movement-related cortical potentials and their application in brain–computer interfacing , 2013 .

[11]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[12]  D. Wolpert,et al.  Spatio-Temporal Prediction Modulates the Perception of Self-Produced Stimuli , 1999, Journal of Cognitive Neuroscience.

[13]  Richard A Andersen,et al.  Forward estimation of movement state in posterior parietal cortex , 2008, Proceedings of the National Academy of Sciences.

[14]  H. Flor,et al.  The thought translation device (TTD) for completely paralyzed patients. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[15]  T. Jung,et al.  Translation of EEG Spatial Filters from Resting to Motor Imagery Using Independent Component Analysis , 2012, PloS one.

[16]  Nicolas Schweighofer,et al.  Motor learning without doing: trial-by-trial improvement in motor performance during mental training. , 2010, Journal of neurophysiology.

[17]  Klaus-Robert Müller,et al.  Motor Imagery for Severely Motor-Impaired Patients: Evidence for Brain-Computer Interfacing as Superior Control Solution , 2014, PloS one.

[18]  A. Kheddar,et al.  Forward modelling the rubber hand: illusion of ownership modifies motor-sensory predictions by the brain , 2016, Royal Society Open Science.

[19]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[20]  G Townsend,et al.  Pushing the P300-based brain-computer interface beyond 100 bpm: extending performance guided constraints into the temporal domain. , 2016, Journal of neural engineering.

[21]  Masa-aki Sato,et al.  Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns , 2008, NeuroImage.

[22]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[23]  G R Müller-Putz,et al.  From classic motor imagery to complex movement intention decoding: The noninvasive Graz-BCI approach. , 2016, Progress in brain research.

[24]  Eiichi Naito,et al.  Human limb‐specific and non‐limb‐specific brain representations during kinesthetic illusory movements of the upper and lower extremities , 2007, The European journal of neuroscience.

[25]  M. Hallett,et al.  What is the Bereitschaftspotential? , 2006, Clinical Neurophysiology.

[26]  L. Miller,et al.  Electrical Stimulation of the Proprioceptive Cortex (Area 3a) Used to Instruct a Behaving Monkey , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  István Czigler,et al.  Visual mismatch negativity (vMMN): a prediction error signal in the visual modality , 2015, Front. Hum. Neurosci..

[28]  D. Poeppel,et al.  Health, USA Reviewed by: , 2010 .

[29]  Risto Näätänen,et al.  Electromagnetic responses of the human auditory cortex generated by sensory-memory based processing of tone-frequency changes , 1999, Neuroscience Letters.

[30]  D. Wolpert,et al.  Motor prediction , 2001, Current Biology.

[31]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[32]  R. Osu,et al.  Feeling the force: Returning haptic signals influence effort inference during motor coordination , 2013, Scientific Reports.

[33]  J. Krakauer,et al.  Sensory prediction errors drive cerebellum-dependent adaptation of reaching. , 2007, Journal of neurophysiology.

[34]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[35]  J. Wolpaw,et al.  Answering questions with an electroencephalogram-based brain-computer interface. , 1998, Archives of physical medicine and rehabilitation.

[36]  Brian L. Day,et al.  Galvanic vestibular stimulation evokes sensations of body rotation , 2002, Neuroreport.

[37]  R. Näätänen,et al.  Early selective-attention effect on evoked potential reinterpreted. , 1978, Acta psychologica.

[38]  Scott T. Grafton,et al.  Role of the posterior parietal cortex in updating reaching movements to a visual target , 1999, Nature Neuroscience.

[39]  G. Stefanics,et al.  Visual mismatch negativity: a predictive coding view , 2014, Front. Hum. Neurosci..

[40]  B. Rockstroh,et al.  Slow potentials of the cerebral cortex and behavior. , 1990, Physiological reviews.

[41]  Brian L Day,et al.  Probing the human vestibular system with galvanic stimulation. , 2004, Journal of applied physiology.

[42]  Anna Weinberg,et al.  Error-related brain activity in the age of RDoC: A review of the literature. , 2015, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[43]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[44]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[45]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[46]  Satoshi Hirose,et al.  An empirical solution for over-pruning with a novel ensemble-learning method for fMRI decoding , 2015, Journal of Neuroscience Methods.

[47]  Heinrich H. Bülthoff,et al.  Reaching with the sixth sense: Vestibular contributions to voluntary motor control in the human right parietal cortex , 2016, NeuroImage.