Prior Knowledge of Target Direction and Intended Movement Selection Improves Indirect Reaching Movement Decoding

Objective. Previous studies have demonstrated that target direction information presented by the dorsal premotor cortex (PMd) during movement planning could be incorporated into neural decoder for achieving better decoding performance. It is still unknown whether the neural decoder combined with only target direction could work in more complex tasks where obstacles impeded direct reaching paths. Methods. In this study, spike activities were collected from the PMd of two monkeys when performing a delayed obstacle-avoidance task. We examined how target direction and intended movement selection were encoded in neuron population activities of the PMd during movement planning. The decoding performances of movement trajectory were compared for three neural decoders with no prior knowledge, or only target direction, or both target direction and intended movement selection integrated into a mixture of trajectory model (MTM). Results. We found that not only target direction but also intended movement selection was presented in neural activities of the PMd during movement planning. It was further confirmed by quantitative analysis. Combined with prior knowledge, the trajectory decoder achieved the best performance among three decoders. Conclusion. Recruiting prior knowledge about target direction and intended movement selection extracted from the PMd could enhance the decoding performance of hand trajectory in indirect reaching movement.

[1]  R A Normann,et al.  The Utah intracortical Electrode Array: a recording structure for potential brain-computer interfaces. , 1997, Electroencephalography and clinical neurophysiology.

[2]  K.V. Shenoy,et al.  Model-based decoding of reaching movements for prosthetic systems , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Yaoyao Hao,et al.  Development of an invasive brain-machine interface with a monkey model , 2012, Chinese Science Bulletin.

[4]  José Carlos Príncipe,et al.  Maximum correntropy based attention-gated reinforcement learning designed for brain machine interface , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Byron M. Yu,et al.  Detecting neural-state transitions using hidden Markov models for motor cortical prostheses. , 2008, Journal of neurophysiology.

[6]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[7]  Stephen I. Ryu,et al.  A High-Performance Keyboard Neural Prosthesis Enabled by Task Optimization , 2015, IEEE Transactions on Biomedical Engineering.

[8]  Nitish V. Thakor,et al.  High Precision Neural Decoding of Complex Movement Trajectories Using Recursive Bayesian Estimation With Dynamic Movement Primitives , 2016, IEEE Robotics and Automation Letters.

[9]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[10]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[11]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[12]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[13]  R E Kass,et al.  Recursive bayesian decoding of motor cortical signals by particle filtering. , 2004, Journal of neurophysiology.

[14]  Daniel W Moran,et al.  Strategy-Dependent Encoding of Planned Arm Movements in the Dorsal Premotor Cortex , 2012, Science.

[15]  Byron M. Yu,et al.  Mixture of Trajectory Models for Neural Decoding of Goal-directed Movements a Computational Model of Craving and Obsession Decoding Visual Inputs from Multiple Neurons in the Human Temporal Lobe Encoding Contribution of Individual Retinal Ganglion Cell Responses to Velocity and Acceleration , 2008 .

[16]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[17]  Afsheen Afshar,et al.  Free-paced high-performance brain-computer interfaces. , 2007, Journal of neural engineering.

[18]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[19]  Jose M. Carmena,et al.  Rapid control and feedback rates enhance neuroprosthetic control , 2017, Nature Communications.

[20]  Marc H Schieber,et al.  State-based decoding of hand and finger kinematics using neuronal ensemble and LFP activity during dexterous reach-to-grasp movements. , 2013, Journal of neurophysiology.

[21]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[22]  R. Jacob Vogelstein,et al.  The use of a virtual integration environment for the real-time implementation of neural decode algorithms , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[24]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[25]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[26]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[27]  S. Wise,et al.  The premotor cortex of the monkey , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[29]  S. Wise The primate premotor cortex: past, present, and preparatory. , 1985, Annual review of neuroscience.

[30]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  B.M. Yu,et al.  Improving neural prosthetic system performance by combining plan and peri-movement activity , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[33]  Jun Tanji,et al.  Integration of target and body-part information in the premotor cortex when planning action , 2000, Nature.

[34]  Byron M. Yu,et al.  Neural Variability in Premotor Cortex Provides a Signature of Motor Preparation , 2006, The Journal of Neuroscience.

[35]  S. Wise,et al.  Effects of hand movement path on motor cortical activity in awake, behaving rhesus monkeys , 2004, Experimental Brain Research.

[36]  Fang Wang,et al.  Neural Control of a Tracking Task via Attention-Gated Reinforcement Learning for Brain-Machine Interfaces , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  P T Sadtler,et al.  Brain–computer interface control along instructed paths , 2015, Journal of neural engineering.

[38]  Ziv M. Williams,et al.  A Real-Time Brain-Machine Interface Combining Motor Target and Trajectory Intent Using an Optimal Feedback Control Design , 2013, PloS one.

[39]  Pieter R. Roelfsema,et al.  Attention-Gated Reinforcement Learning of Internal Representations for Classification , 2005, Neural Computation.

[40]  G. W. Wornell,et al.  Feedback-Controlled Parallel Point Process Filter for Estimation of Goal-Directed Movements From Neural Signals , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Stephen I. Ryu,et al.  A High-Performance Neural Prosthesis Incorporating Discrete State Selection With Hidden Markov Models , 2017, IEEE Transactions on Biomedical Engineering.

[42]  Joseph T. Francis,et al.  A bio-friendly and economical technique for chronic implantation of multiple microelectrode arrays , 2010, Journal of Neuroscience Methods.

[43]  J. Donoghue,et al.  Neuronal Interactions Improve Cortical Population Coding of Movement Direction , 1999, The Journal of Neuroscience.