Single trial prediction of self-paced reaching directions from EEG signals

Early detection of movement intention could possibly minimize the delays in the activation of neuroprosthetic devices. As yet, single trial analysis using non-invasive approaches for understanding such movement preparation remains a challenging task. We studied the feasibility of predicting movement directions in self-paced upper limb center-out reaching tasks, i.e., spontaneous movements executed without an external cue that can better reflect natural motor behavior in humans. We reported results of non-invasive electroencephalography (EEG) recorded from mild stroke patients and able-bodied participants. Previous studies have shown that low frequency EEG oscillations are modulated by the intent to move and therefore, can be decoded prior to the movement execution. Motivated by these results, we investigated whether slow cortical potentials (SCPs) preceding movement onset can be used to classify reaching directions and evaluated the performance using 5-fold cross-validation. For able-bodied subjects, we obtained an average decoding accuracy of 76% (chance level of 25%) at 62.5 ms before onset using the amplitude of on-going SCPs with above chance level performances between 875 to 437.5 ms prior to onset. The decoding accuracy for the stroke patients was on average 47% with their paretic arms. Comparison of the decoding accuracy across different frequency ranges (i.e., SCPs, delta, theta, alpha, and gamma) yielded the best accuracy using SCPs filtered between 0.1 to 1 Hz. Across all the subjects, including stroke subjects, the best selected features were obtained mostly from the fronto-parietal regions, hence consistent with previous neurophysiological studies on arm reaching tasks. In summary, we concluded that SCPs allow the possibility of single trial decoding of reaching directions at least 312.5 ms before onset of reach.

[1]  F. Offner,et al.  The EEG as potential mapping: the value of the average monopolar reference. , 1950, Electroencephalography and clinical neurophysiology.

[2]  J. W. Osselton,et al.  Acquisition of EEG data by bipolar, unipolar and average reference methods: a theoretical comparison. , 1965, Electroencephalography and clinical neurophysiology.

[3]  David G. Stork,et al.  Pattern Classification , 1973 .

[4]  P. Roland,et al.  Different cortical areas in man in organization of voluntary movements in extrapersonal space. , 1980, Journal of neurophysiology.

[5]  G. Pfurtscheller,et al.  Brain electrical activity mapping in normal and ischemic brain. , 1984, Progress in brain research.

[6]  O Bertrand,et al.  A theoretical justification of the average reference in topographic evoked potential studies. , 1985, Electroencephalography and clinical neurophysiology.

[7]  A. P. Georgopoulos,et al.  Functional magnetic resonance imaging of motor cortex: hemispheric asymmetry and handedness. , 1993, Science.

[8]  J. Polich,et al.  P300 in young and elderly subjects: auditory frequency and intensity effects. , 1993, Electroencephalography and clinical neurophysiology.

[9]  D Friedman,et al.  An overview of age-related changes in the scalp distribution of P3b. , 1997, Electroencephalography and clinical neurophysiology.

[10]  Jr. S. Marple,et al.  Computing the discrete-time 'analytic' signal via FFT , 1999, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[11]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[12]  N. Birbaumer,et al.  Self-regulation of slow cortical potentials in completely paralyzed human patients , 1998, Neuroscience Letters.

[13]  N. Birbaumer slow Cortical Potentials: Plasticity, Operant Control, and Behavioral Effects , 1999 .

[14]  F. Lacquaniti,et al.  Parieto-frontal coding of reaching: an integrated framework , 1999, Experimental Brain Research.

[15]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[16]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[17]  R. Veit,et al.  Self-regulation of slow cortical potentials: an event-related fMRI study , 2000, NeuroImage.

[18]  P. Viviani,et al.  Internally driven vs. externally cued movement selection: a study on the timing of brain activity. , 2000, Brain research. Cognitive brain research.

[19]  M. Levin,et al.  Compensatory strategies for reaching in stroke. , 2000, Brain : a journal of neurology.

[20]  A. Friederici,et al.  Slow cortical potentials during retention of object, spatial, and verbal information. , 2001, Brain research. Cognitive brain research.

[21]  Yale E. Cohen,et al.  A common reference frame for movement plans in the posterior parietal cortex , 2002, Nature Reviews Neuroscience.

[22]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[23]  S. Meagher Instant neural control of a movement signal , 2002 .

[24]  R. Andersen,et al.  Intentional maps in posterior parietal cortex. , 2002, Annual review of neuroscience.

[25]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[26]  Alvaro Pascual-Leone,et al.  Ipsilateral motor cortex activation on functional magnetic resonance imaging during unilateral hand movements is related to interhemispheric interactions , 2003, NeuroImage.

[27]  J. Kevin O'Regan,et al.  Is There Something Out There? Inferring Space from Sensorimotor Dependencies , 2003, Neural Computation.

[28]  Francesco Lacquaniti,et al.  Multiple levels of representation of reaching in the parieto-frontal network. , 2003, Cerebral cortex.

[29]  Richard A. Andersen,et al.  FMRI evidence for a 'parietal reach region' in the human brain , 2003, Experimental Brain Research.

[30]  C. Mehring,et al.  Inference of hand movements from local field potentials in monkey motor cortex , 2003, Nature Neuroscience.

[31]  Hermano Igo Krebs,et al.  Rehabilitation Robotics: Performance-Based Progressive Robot-Assisted Therapy , 2003, Auton. Robots.

[32]  Scott E Kerick,et al.  Independent component analysis of dynamic brain responses during visuomotor adaptation , 2004, NeuroImage.

[33]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[34]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[35]  J. Schaechter Motor rehabilitation and brain plasticity after hemiparetic stroke , 2004, Progress in Neurobiology.

[36]  Adam N Mamelak,et al.  Spatial selectivity in human ventrolateral prefrontal cortex , 2005, Nature Neuroscience.

[37]  C. Mehring,et al.  Encoding of Movement Direction in Different Frequency Ranges of Motor Cortical Local Field Potentials , 2005, The Journal of Neuroscience.

[38]  R. Andersen,et al.  Cognitive neural prosthetics. , 2010, Annual review of psychology.

[39]  Steven Lemm,et al.  Aggregating Classification Accuracy across Time: Application to Single Trial EEG , 2006, NIPS.

[40]  R. Andersen,et al.  Movement Intention Is Better Predicted than Attention in the Posterior Parietal Cortex , 2006, The Journal of Neuroscience.

[41]  Yijun Wang,et al.  Phase Synchrony Measurement in Motor Cortex for Classifying Single-trial EEG during Motor Imagery , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  W Pieter Medendorp,et al.  Behavioral reference frames for planning human reaching movements. , 2006, Journal of neurophysiology.

[43]  Kenneth F. Valyear,et al.  Human parietal cortex in action , 2006, Current Opinion in Neurobiology.

[44]  J. Colebatch Bereitschaftspotential and movement‐related potentials: Origin, significance, and application in disorders of human movement , 2007, Movement disorders : official journal of the Movement Disorder Society.

[45]  J. Guardia,et al.  Feature Extraction for Multi-class BCI using Canonical Variates Analysis , 2007, 2007 IEEE International Symposium on Intelligent Signal Processing.

[46]  José del R. Millán,et al.  Advances in Cognitive Neural Prosthesis: Recognition of Neural Data with an Information-Theoretic Objective , 2007 .

[47]  B. Dobkin Brain–computer interface technology as a tool to augment plasticity and outcomes for neurological rehabilitation , 2007, The Journal of physiology.

[48]  J. Gottlieb From Thought to Action: The Parietal Cortex as a Bridge between Perception, Action, and Cognition , 2007, Neuron.

[49]  A. Schwartz,et al.  Useful signals from motor cortex , 2005, The Journal of physiology.

[50]  Andrea Brovelli,et al.  EEG dynamics of the frontoparietal network during reaching preparation in humans , 2007, NeuroImage.

[51]  H. Krebs,et al.  Effects of Robot-Assisted Therapy on Upper Limb Recovery After Stroke: A Systematic Review , 2008, Neurorehabilitation and neural repair.

[52]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[53]  H. Poizner,et al.  Predicting Reaching Targets from Human EEG , 2008, IEEE Signal Processing Magazine.

[54]  J. del R. Millán,et al.  Characterizing the EEG Correlates of Exploratory Behavior , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[55]  C. Braun,et al.  Hand Movement Direction Decoded from MEG and EEG , 2008, The Journal of Neuroscience.

[56]  Gunnar Blohm,et al.  Decoding the cortical transformations for visually guided reaching in 3D space. , 2009, Cerebral cortex.

[57]  Yijun Wang,et al.  Predicting Intended Movement Direction Using EEG from Human Posterior Parietal Cortex , 2009, HCI.

[58]  C. Mehring,et al.  Differential Representation of Arm Movement Direction in Relation to Cortical Anatomy and Function , 2008 .

[59]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[60]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[61]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[62]  Flavia Filimon Human Cortical Control of Hand Movements: Parietofrontal Networks for Reaching, Grasping, and Pointing , 2010, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[63]  Ahmed H. Tewfik,et al.  High Accuracy Decoding of Movement Target Direction in Non-Human Primates Based on Common Spatial Patterns of Local Field Potentials , 2010, PloS one.

[64]  D. Farina,et al.  Detection of movement intention from single-trial movement-related cortical potentials , 2011, Journal of neural engineering.

[65]  Kenneth F. Valyear,et al.  Decoding Action Intentions from Preparatory Brain Activity in Human Parieto-Frontal Networks , 2011, The Journal of Neuroscience.

[66]  Dawn M. Taylor,et al.  Extracting Attempted Hand Movements from EEGs in People with Complete Hand Paralysis Following Stroke , 2011, Front. Neurosci..

[67]  José del R. Millán,et al.  Phase-based features for motor imagery brain-computer interfaces , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[68]  Peter J. Ifft,et al.  Active tactile exploration enabled by a brain-machine-brain interface , 2011, Nature.

[69]  Hannes Bleuler,et al.  Active tactile exploration enabled by a brain-machine-brain interface , 2011, Nature.

[70]  Cuntai Guan,et al.  A Large Clinical Study on the Ability of Stroke Patients to Use an EEG-Based Motor Imagery Brain-Computer Interface , 2011, Clinical EEG and neuroscience.

[71]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[72]  Ricardo Chavarriaga,et al.  Self-paced movement intention detection from human brain signals: Invasive and non-invasive EEG , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[73]  Eric J Perreault,et al.  Decoding with limited neural data: a mixture of time-warped trajectory models for directional reaches , 2012, Journal of neural engineering.

[74]  Jörg Fischer,et al.  An online brain–machine interface using decoding of movement direction from the human electrocorticogram , 2012, Journal of neural engineering.

[75]  Ning Jiang,et al.  Peripheral Electrical Stimulation Triggered by Self-Paced Detection of Motor Intention Enhances Motor Evoked Potentials , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[76]  Nick F. Ramsey,et al.  Human Motor Cortical Activity Is Selectively Phase-Entrained on Underlying Rhythms , 2012, PLoS Comput. Biol..

[77]  J. Millán,et al.  Detection of self-paced reaching movement intention from EEG signals , 2012, Front. Neuroeng..

[78]  Y. Kamitani,et al.  Regulation of Motor Representation by Phase–Amplitude Coupling in the Sensorimotor Cortex , 2012, The Journal of Neuroscience.

[79]  香川 美仁,et al.  Effects of Robot Assisted Therapy , 2012 .

[80]  A. Aertsen,et al.  The role of ECoG magnitude and phase in decoding position, velocity, and acceleration during continuous motor behavior , 2013, Front. Neurosci..

[81]  J. Millán,et al.  Single trial analysis of slow cortical potentials: a study on anticipation related potentials , 2013, Journal of neural engineering.

[82]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[83]  José del R. Millán,et al.  Transferring brain-computer interfaces beyond the laboratory: Successful application control for motor-disabled users , 2013, Artif. Intell. Medicine.

[84]  Silvestro Micera,et al.  Brain–machine interface: closer to therapeutic reality? , 2013, The Lancet.

[85]  L. Cohen,et al.  Brain–machine interface in chronic stroke rehabilitation: A controlled study , 2013, Annals of neurology.

[86]  Benedict Shien Wei Ng,et al.  EEG phase patterns reflect the selectivity of neural firing. , 2013, Cerebral cortex.

[87]  Keng Peng Tee,et al.  Multi-class EEG classification of voluntary hand movement directions , 2013, Journal of neural engineering.

[88]  J. Millán,et al.  Motor Recovery After Stroke by Means of BCI-Guided Functional Electrical Stimulation , 2013 .

[89]  Ning Jiang,et al.  Enhanced Low-Latency Detection of Motor Intention From EEG for Closed-Loop Brain-Computer Interface Applications , 2014, IEEE Transactions on Biomedical Engineering.

[90]  Cuntai Guan,et al.  A Randomized Controlled Trial of EEG-Based Motor Imagery Brain-Computer Interface Robotic Rehabilitation for Stroke , 2015, Clinical EEG and neuroscience.