Decoding Velocity from Spikes Using a New Architecture of Recurrent Neural Network

Motor brain-machine interfaces (BMIs) usually collect neuronal activity from the dorsal premotor cortex (PMd) and primary motor cortex (M1). As the pattern of interconnections between PMd and M1 is complex, current BMI decoders directly decode PMd and M1 neural signals without considering the interconnections between these cortical areas. In this paper, a new architecture of recurrent neural network (Double Recurrent Neural Network, DRNN) was proposed, which took the interconnection information between PMd and M1 into account. To evaluate the performance of DRNN, we recorded the spike data and the position of a robotic arm when a rhesus monkey performed one-dimensional robotic arm reach task. When DRNN decoder offline decoded the velocity of the robotic arm, it showed high decoding accuracy of 0.92 ± 0.04 (correlation coefficient) and strong robustness to noise and recording conditions change. The DRNN outperformed basic RNN and state-of-the-art velocity Kalman filter (VKF) in both decoding accuracy and robustness. It suggested that our proposed DRNN could be a promising BMI decoding algorithm.

[1]  L. Miller,et al.  Primary motor cortical neurons encode functional muscle synergies , 2002, Experimental Brain Research.

[2]  J.C. Sanchez,et al.  Interpreting spatial and temporal neural activity through a recurrent neural network brain-machine interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  A. Georgopoulos,et al.  The motor cortex and the coding of force. , 1992, Science.

[4]  P. Strick,et al.  Motor areas in the frontal lobe of the primate , 2002, Physiology & Behavior.

[5]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[6]  David Sussillo,et al.  Making brain–machine interfaces robust to future neural variability , 2016, Nature Communications.

[7]  Konrad Paul Kording,et al.  Premotor and Motor Cortices Encode Reward , 2016, PloS one.

[8]  Robert Chen,et al.  Functional interaction between human dorsal premotor cortex and the ipsilateral primary motor cortex for grasp plans: a dual-site TMS study , 2018, Neuroreport.

[9]  Ilya Sutskever,et al.  Learning Recurrent Neural Networks with Hessian-Free Optimization , 2011, ICML.

[10]  Odelia Schwartz,et al.  Decoding of finger trajectory from ECoG using deep learning , 2018, Journal of neural engineering.

[11]  M. Nicolelis,et al.  Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation. , 2017, Physiological reviews.

[12]  P. Strick,et al.  Frontal Lobe Inputs to the Digit Representations of the Motor Areas on the Lateral Surface of the Hemisphere , 2005, The Journal of Neuroscience.

[13]  Ilya Sutskever,et al.  Training Deep and Recurrent Networks with Hessian-Free Optimization , 2012, Neural Networks: Tricks of the Trade.

[14]  Mikhail A. Lebedev,et al.  Chronic, Wireless Recordings of Large Scale Brain Activity in Freely Moving Rhesus Monkeys , 2014, Nature Methods.