Overcoming Long-Term Variability in Local Field Potentials Using an Adaptive Decoder

Long-term variability remains one of the major hurdles in using intracortical recordings like local field potentials for brain computer interfaces (BCI). Practical neural decoders need to overcome time instability of neural signals to estimate subject behavior accurately and faithfully over the long term. This paper presents a novel decoder that 1) characterizes each behavioral task (i.e., different movement directions under different force conditions) with multiple neural patterns and 2) adapts to the long-term variations in neural features by identifying the stable neural patterns. This adaptation can be performed in both an unsupervised and a semisupervised learning framework requiring minimal feedback from the user. To achieve generalization over time, the proposed decoder uses redundant sparse regression models that adapt to day-to-day variations in neural patterns. While this update requires no explicit feedback from the BCI user, any feedback (explicit or derived) to the BCI improves its performance. With this adaptive decoder, we investigated the effects of long-term neural modulation especially when subjects encountered new external forces against movement. The proposed decoder predicted eight hand-movement directions with an accuracy of 95% over two weeks (when there was no external forces); and 85% in later acquisition sessions spanning up to 42 days (when the monkeys countered external field forces). Since the decoder can operate with or without manual intervention, it could alleviate user frustration associated with BCI.

[1]  José Carlos Príncipe,et al.  Coadaptive Brain–Machine Interface via Reinforcement Learning , 2009, IEEE Transactions on Biomedical Engineering.

[2]  Michael J. Black,et al.  Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array , 2011 .

[3]  Motoaki Kawanabe,et al.  Invariant Common Spatial Patterns: Alleviating Nonstationarities in Brain-Computer Interfacing , 2007, NIPS.

[4]  Bernhard Schölkopf,et al.  Kernel Dependency Estimation , 2002, NIPS.

[5]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[6]  J. Hohnsbein,et al.  ERP components on reaction errors and their functional significance: a tutorial , 2000, Biological Psychology.

[7]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[8]  Nicholas G Hatsopoulos,et al.  Early visuomotor representations revealed from evoked local field potentials in motor and premotor cortical areas. , 2006, Journal of neurophysiology.

[9]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[10]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[11]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[12]  C. Mehring,et al.  Encoding of Movement Direction in Different Frequency Ranges of Motor Cortical Local Field Potentials , 2005, The Journal of Neuroscience.

[13]  José del R. Millán,et al.  Error-Related EEG Potentials Generated During Simulated Brain–Computer Interaction , 2008, IEEE Transactions on Biomedical Engineering.

[14]  S. Micera,et al.  EMG-based pattern recognition approach in post stroke robot-aided rehabilitation: a feasibility study , 2013, Journal of NeuroEngineering and Rehabilitation.

[15]  Jonathan R. Wolpaw,et al.  Brain-computer interfaces (BCIs) for communication and control , 2007, Assets '07.

[16]  L. Miller,et al.  Accurate decoding of reaching movements from field potentials in the absence of spikes , 2012, Journal of neural engineering.

[17]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[18]  Justin C. Sanchez,et al.  Using Reinforcement Learning to Provide Stable Brain-Machine Interface Control Despite Neural Input Reorganization , 2014, PloS one.

[19]  D.J. McFarland,et al.  Sensorimotor rhythm-based brain-computer interface (BCI): feature selection by regression improves performance , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  David A. Leopold,et al.  Single-trial evoked potential estimation using wavelets , 2007, Comput. Biol. Medicine.

[21]  N. Nikolaev,et al.  Sequential relevance vector machine learning from time series , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[22]  J. M. Carmena,et al.  Closed-Loop Decoder Adaptation on Intermediate Time-Scales Facilitates Rapid BMI Performance Improvements Independent of Decoder Initialization Conditions , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Nicolas Y. Masse,et al.  Advantages of closed-loop calibration in intracortical brain–computer interfaces for people with tetraplegia , 2013, Journal of neural engineering.

[24]  G. Pfurtscheller,et al.  EEG-based communication: presence of an error potential , 2000, Clinical Neurophysiology.

[25]  Robert D Flint,et al.  Long term, stable brain machine interface performance using local field potentials and multiunit spikes , 2013, Journal of neural engineering.

[26]  Michael J. Frank,et al.  Error-Related Negativity Predicts Reinforcement Learning and Conflict Biases , 2005, Neuron.

[27]  R. Andersen,et al.  Cortical Local Field Potential Encodes Movement Intentions in the Posterior Parietal Cortex , 2005, Neuron.

[28]  Yali Amit,et al.  Single-unit stability using chronically implanted multielectrode arrays. , 2009, Journal of neurophysiology.

[29]  Gökhan BakIr,et al.  Extension to Kernel Dependency Estimation with Applications to Robotics , 2005 .

[30]  Ahmed H. Tewfik,et al.  Time robust movement direction decoding in Local Field Potentials using channel ranking , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[31]  Ahmed H. Tewfik,et al.  Robust movement direction decoders from local field potentials using spatio-temporal qualitative patterns , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  Ahmed H. Tewfik,et al.  High Accuracy Decoding of Movement Target Direction in Non-Human Primates Based on Common Spatial Patterns of Local Field Potentials , 2010, PloS one.

[33]  José del R. Millán,et al.  You Are Wrong! - Automatic Detection of Interaction Errors from Brain Waves , 2005, IJCAI.

[34]  Winnie Jensen,et al.  On variability and use of rat primary motor cortex responses in behavioral task discrimination , 2006, Journal of neural engineering.

[35]  W. Gehring,et al.  Neural Systems for Error Monitoring , 2007, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[36]  Michael E. Tipping,et al.  Fast Marginal Likelihood Maximisation for Sparse Bayesian Models , 2003 .

[37]  Eran Stark,et al.  Comparison of direction and object selectivity of local field potentials and single units in macaque posterior parietal cortex during prehension. , 2007, Journal of neurophysiology.

[38]  Rajesh P. N. Rao,et al.  Exploring the Cortical Dynamics of Learning by Leveraging BCI Paradigms , 2013 .

[39]  Desney S. Tan,et al.  Brain-Computer Interfacing for Intelligent Systems , 2008, IEEE Intelligent Systems.

[40]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[41]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[42]  Tayfun Gürel,et al.  Unsupervised Adaptation of Brain-Machine Interface Decoders , 2012, Front. Neurosci..

[43]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[44]  B V Gowreesunker,et al.  A Subspace Approach to Learning Recurrent Features From Brain Activity , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[45]  Bashar Zogheib Elementary Statistics: A Step by Step Approach , 2012 .

[46]  Richard L. White Object Classification in Astronomical Images , 1997 .