FROM CORTICAL NEURAL SPIKE TRAINS TO BEHAVIOR: MODELING AND ANALYSIS

of Dissertation Presented to the Graduate School of the University of Florida in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy FROM CORTICAL NEURAL SPIKE TRAINS TO BEHAVIOR: MODELING AND ANALYSIS By Justin Cort Sanchez May 2004 Chair: Jose C. Principe Major Department: Biomedical Engineering Brain machine interface (BMI) design can be achieved by training linear and nonlinear models with simultaneously recorded cortical neural activity and goal directed behavior. Real-time implementation of this technology requires reliable and accurate signal processing models that produce small error variance in the estimated kinematic trajectories. In this dissertation, the mapping performance and generalization of a recurrent multilayer perceptron (RMLP) is compared with standard linear and nonlinear signal processing models for two species of primates and two behavioral tasks. Each modeling approach is shown to have strengths and weaknesses that are compared experimentally. The RMLP approach shows very accurate peak amplitude estimations with small error variance using a parsimonious model topology. To validate and advance the state-of-the-art of this BMI modeling design, it is necessary to understand how the proposed model represents the neural-to-motor mappings. The RMLP is analyzed here and an interpretation of the neural-to-motor solution of this network is built by tracing the

[1]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[2]  Michael J. Black,et al.  Modeling and decoding motor cortical activity using a switching Kalman filter , 2004, IEEE Transactions on Biomedical Engineering.

[3]  A. Schwartz,et al.  Motor cortical activity during drawing movements: population representation during spiral tracing. , 1999, Journal of neurophysiology.

[4]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[5]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[7]  Jude W. Shavlik,et al.  Visualizing Learning and Computation in Artificial Neural Networks , 1992, Int. J. Artif. Intell. Tools.

[8]  S. Grossberg.  Studies of mind and brain : neural principles of learning, perception, development, cognition, and motor control , 1982 .

[9]  H. Akaike.  Statistical predictor identification , 1970 .

[10]  W. T. Thach.  Correlation of neural discharge with pattern and force of muscular activity, joint position, and direction of intended next movement in motor cortex and cerebellum. , 1978, Journal of neurophysiology.

[11]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[12]  T. Sanger,et al.  Probability density estimation for the interpretation of neural population codes. , 1996, Journal of neurophysiology.

[13]  S. Scott,et al.  Changes in motor cortex activity during reaching movements with similar hand paths but different arm postures. , 1995, Journal of neurophysiology.

[14]  Jude W. Shavlik,et al.  Interpretation of Artificial Neural Networks: Mapping Knowledge-Based Neural Networks into Rules , 1991, NIPS.

[15]  Lennart Ljung.  Black-box models from input-output measurements , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[16]  Edward M. Schmidt,et al.  Single neuron recording from motor cortex as a possible source of signals for control of external devices , 2006, Annals of Biomedical Engineering.

[17]  Deniz Erdogmus,et al.  Input-output mapping performance of linear and nonlinear models for estimating hand trajectories from cortical neuronal firing patterns , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[18]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[19]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[20]  S. Schultz.  Principles of Neural Science, 4th ed. , 2001 .

[21]  J. Tanji,et al.  Neuronal activity in cortical motor areas related to ipsilateral, contralateral, and bilateral digit movements of the monkey. , 1988, Journal of neurophysiology.

[22]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series, with Engineering Applications , 1949 .

[23]  Michael J. Black,et al.  A quantitative comparison of linear and non-linear models of motor cortical activity for the encoding and decoding of arm motions , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[24]  D. Crammond.  Motor imagery: never in your wildest dream , 1997, Trends in Neurosciences.

[25]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[26]  Deniz Erdogmus,et al.  Divide-and-conquer approach for brain machine interfaces: nonlinear mixture of competitive linear models , 2003, Neural Networks.

[27]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[28]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .

[29]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[30]  T. Ebner,et al.  Temporal encoding of movement kinematics in the discharge of primate primary motor and premotor neurons. , 1995, Journal of neurophysiology.

[31]  J.C. Sanchez,et al.  Learning the contributions of the motor, premotor, and posterior parietal cortices for hand trajectory reconstruction in a brain machine interface , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[32]  E. Todorov.  Direct cortical control of muscle activation in voluntary arm movements: a model , 2000, Nature Neuroscience.

[33]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[34]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[35]  Jennie Si,et al.  Self-Organization of Firing Activities in Monkey's Motor Cortex: Trajectory Computation from Spike Signals , 1997, Neural Computation.

[36]  J. T. Massey,et al.  Mental rotation of the neuronal population vector. , 1989, Science.

[37]  Grace Wahba,et al.  Spline Models for Observational Data , 1990 .

[38]  Michael J. Black,et al.  Inferring Hand Motion from Multi-Cell Recordings in Motor Cortex using a Kalman Filter , 2002 .

[39]  E. Fetz.  Movement control: Are movement parameters recognizably coded in the activity of single neurons? , 1992 .

[40]  J. Kalaska,et al.  A comparison of movement direction-related versus load direction- related activity in primate motor cortex, using a two-dimensional reaching task , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[41]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[42]  H. Akaike.  A new look at the statistical model identification , 1974 .

[43]  John E. Moody,et al.  The Effective Number of Parameters: An Analysis of Generalization and Regularization in Nonlinear Learning Systems , 1991, NIPS.

[44]  W. Freeman.  Mesoscopic neurodynamics: From neuron to brain , 2000, Journal of Physiology-Paris.

[45]  L. Fu,et al.  Sensitivity analysis for input vector in multilayer feedforward neural networks , 1993, IEEE International Conference on Neural Networks.

[46]  M. Hallett,et al.  Role of the Ipsilateral Motor Cortex in Voluntary Movement , 1997, Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques.

[47]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[48]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. II. Coding of the direction of movement by a neuronal population , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[49]  Deniz Erdogmus,et al.  A Comparison between Nonlinear Mappings and Linear State Estimation to Model the Relation from Motor Cortical Neuronal Firing to Hand Movements , 2002 .

[50]  Dawn M. Taylor,et al.  Extraction algorithms for cortical control of arm prosthetics , 2001, Current Opinion in Neurobiology.

[51]  Paul Cisek,et al.  Neural activity in primary motor and dorsal premotor cortex in reaching tasks with the contralateral versus ipsilateral arm. , 2003, Journal of neurophysiology.

[52]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[53]  Deniz Erdogmus,et al.  Interpreting neural activity through linear and nonlinear models for brain machine interfaces , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[54]  F. Mussa-Ivaldi,et al.  Do neurons in the motor cortex encode movement direction? An alternative hypothesis , 1988, Neuroscience Letters.

[55]  R E Kass,et al.  Recursive bayesian decoding of motor cortical signals by particle filtering. , 2004, Journal of neurophysiology.

[56]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces to restore motor function and probe neural circuits , 2003, Nature Reviews Neuroscience.

[57]  J Hore,et al.  Relations of motor cortex neural discharge to kinematics of passive and active elbow movements in the monkey. , 1988, Journal of neurophysiology.

[58]  S. Scott,et al.  Cortical control of reaching movements , 1997, Current Opinion in Neurobiology.

[59]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[60]  John Moody,et al.  Prediction Risk and Architecture Selection for Neural Networks , 1994 .

[61]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[62]  R. Andersen,et al.  Multimodal representation of space in the posterior parietal cortex and its use in planning movements. , 1997, Annual review of neuroscience.

[63]  Deniz Erdogmus,et al.  Modeling the relation from motor cortical neuronal firing to hand movements using competitive linear filters and a MLP , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[64]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[65]  R. Andersen,et al.  Neural prosthetic control signals from plan activity , 2003, Neuroreport.

[66]  Simon Haykin,et al.  Adaptive filter theory (2nd ed.) , 1991 .