Dimensionality Reduction of Local Field Potential Features with Convolution Neural Network in Neural Decoding: A Pilot Study

Local field potentials (LFPs) have better long-term stability compared with spikes in brain-machine interfaces (BMIs). Many studies have shown promising results of LFP decoding, but the high-dimensional feature of LFP still hurdle the development of the BMIs to low-cost. In this paper, we proposed a framework of a 1D convolution neural network (CNN) to reduce the dimensionality of the LFP features. For evaluating the performance of this architecture, the reduced LFP features were decoded to cursor position (Center-out task) by a Kalman filter. The Principal components analysis (PCA) was also performed as a comparison. The results showed that the CNN model could reduce the dimensionality of LFP features to a smaller size without significant performance loss. The decoding result based on the CNN features outperformed that based on the PCA features. Moreover, the reduced features by CNN also showed robustness across different sessions. These results demonstrated that the LFP features reduced by the CNN model achieved low cost without sacrificing high-performance and robustness, suggesting that this method could be used for portable BMI systems in the future.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Tianqi Chen,et al.  Empirical Evaluation of Rectified Activations in Convolutional Network , 2015, ArXiv.

[3]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[4]  Edward F. Chang,et al.  Speech synthesis from neural decoding of spoken sentences , 2019, Nature.

[5]  Michael J. Black,et al.  Inferring Hand Motion from Multi-Cell Recordings in Motor Cortex using a Kalman Filter , 2002 .

[6]  Lina María Paz,et al.  Divide and Conquer: EKF SLAM in O(n) , 2008, IEEE Trans. Robotics.

[7]  M L Boninger,et al.  Ten-dimensional anthropomorphic arm control in a human brain−machine interface: difficulties, solutions, and limitations , 2015, Journal of neural engineering.

[8]  Anish A. Sarma,et al.  Clinical translation of a high-performance neural prosthesis , 2015, Nature Medicine.

[9]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[10]  Stephen T. Foldes,et al.  Intracortical microstimulation of human somatosensory cortex , 2016, Science Translational Medicine.

[11]  Vikash Gilja,et al.  A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces. , 2011, Journal of neurophysiology.

[12]  David Sussillo,et al.  Making brain–machine interfaces robust to future neural variability , 2016, Nature communications.

[13]  Francis R. Willett,et al.  High performance communication by people with paralysis using an intracortical brain-computer interface , 2017, eLife.

[14]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[15]  Bahar Khalighinejad,et al.  Towards reconstructing intelligible speech from the human auditory cortex , 2019, Scientific Reports.

[16]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  C. Mehring,et al.  Encoding of Movement Direction in Different Frequency Ranges of Motor Cortical Local Field Potentials , 2005, The Journal of Neuroscience.

[19]  Kwabena Boahen,et al.  Design and validation of a real-time spiking-neural-network decoder for brain–machine interfaces , 2013, Journal of neural engineering.

[20]  Adriano B. L. Tort,et al.  Dynamic cross-frequency couplings of local field potential oscillations in rat striatum and hippocampus during performance of a T-maze task , 2008, Proceedings of the National Academy of Sciences.

[21]  Giacomo Indiveri,et al.  A Bidirectional Brain-Machine Interface Featuring a Neuromorphic Hardware Decoder , 2016, Front. Neurosci..

[22]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[23]  Michael L. Boninger,et al.  Demonstration of a portable intracortical brain-computer interface , 2019, Brain-Computer Interfaces.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.