Factor-analysis methods for higher-performance neural prostheses.

Neural prostheses aim to provide treatment options for individuals with nervous-system disease or injury. It is necessary, however, to increase the performance of such systems before they can be clinically viable for patients with motor dysfunction. One performance limitation is the presence of correlated trial-to-trial variability that can cause neural responses to wax and wane in concert as the subject is, for example, more attentive or more fatigued. If a system does not properly account for this variability, it may mistakenly interpret such variability as an entirely different intention by the subject. We report here the design and characterization of factor-analysis (FA)-based decoding algorithms that can contend with this confound. We characterize the decoders (classifiers) on experimental data where monkeys performed both a real reach task and a prosthetic cursor task while we recorded from 96 electrodes implanted in dorsal premotor cortex. The decoder attempts to infer the underlying factors that comodulate the neurons' responses and can use this information to substantially lower error rates (one of eight reach endpoint predictions) by <or=75% (e.g., approximately 20% total prediction error using traditional independent Poisson models reduced to approximately 5%). We also examine additional key aspects of these new algorithms: the effect of neural integration window length on performance, an extension of the algorithms to use Poisson statistics, and the effect of training set size on the decoding accuracy of test data. We found that FA-based methods are most effective for integration windows >150 ms, although still advantageous at shorter timescales, that Gaussian-based algorithms performed better than the analogous Poisson-based algorithms and that the FA algorithm is robust even with a limited amount of training data. We propose that FA-based methods are effective in modeling correlated trial-to-trial neural variability and can be used to substantially increase overall prosthetic system performance.

[1]  Richard A. Andersen,et al.  Latent variable models for neural data analysis , 1999 .

[2]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[3]  R. Andersen,et al.  Mechanisms of Heading Perception in Primate Visual Cortex , 1996, Science.

[4]  D. Boussaoud,et al.  Parietal inputs to dorsal versus ventral premotor areas in the macaque monkey: evidence for largely segregated visuomotor pathways , 2002, Experimental Brain Research.

[5]  Nicholas Hatsopoulos,et al.  Decoding continuous and discrete motor behaviors using motor and premotor cortical ensembles. , 2004, Journal of neurophysiology.

[6]  Christopher A. Buneo,et al.  Direct visuomotor transformations for reaching , 2002, Nature.

[7]  S. Wise,et al.  Effects of hand movement path on motor cortical activity in awake, behaving rhesus monkeys , 2004, Experimental Brain Research.

[8]  Byron M. Yu,et al.  Reference frames for reach planning in macaque dorsal premotor cortex. , 2007, Journal of neurophysiology.

[9]  Paul B. Johnson,et al.  The sources of visual information to the primate frontal lobe: a novel role for the superior parietal lobule. , 1996, Cerebral cortex.

[10]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[11]  Charles G. Gross,et al.  Visual responses with and without fixation: neurons in premotor cortex encode spatial locations independently of eye position , 1998, Experimental Brain Research.

[12]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[13]  S. Wise,et al.  The premotor cortex of the monkey , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  R. Andersen,et al.  Dorsal Premotor Neurons Encode the Relative Position of the Hand, Eye, and Goal during Reach Planning , 2006, Neuron.

[15]  Thomas Lehner,et al.  Epidemiology and Factor Analysis of Obesity, Type II Diabetes, Hypertension, and Dyslipidemia (Syndrome X) on the Island of Kosrae, Federated States of Micronesia , 2000, Human Heredity.

[16]  H. Kuypers,et al.  Premotor cortical ablations in monkeys: contralateral changes in visually guided reaching behavior. , 1977, Science.

[17]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[18]  E. Dooley National Institute of Neurological Disorders and Stroke , 2006 .

[19]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[20]  Philip N. Sabes,et al.  Flexible strategies for sensory integration during motor planning , 2005, Nature Neuroscience.

[21]  Paul Cisek,et al.  Modest gaze-related discharge modulation in monkey dorsal premotor cortex during a reaching task performed with free fixation. , 2002, Journal of neurophysiology.

[22]  Emery N. Brown,et al.  Estimating a State-space Model from Point Process Observations Emery N. Brown , 2022 .

[23]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[24]  C Galletti,et al.  Superior area 6 afferents from the superior parietal lobule in the macaque monkey , 1998, The Journal of comparative neurology.

[25]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[26]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[27]  S. Scott,et al.  Reaching movements with similar hand paths but different arm orientations. I. Activity of individual cells in motor cortex. , 1997, Journal of neurophysiology.

[28]  L. Paninski,et al.  Common-input models for multiple neural spike-train data , 2007, Network.

[29]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  A. Pouget,et al.  Efficient computation and cue integration with noisy population codes , 2001, Nature Neuroscience.

[31]  P R Kennedy,et al.  Direct control of a computer from the human central nervous system. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[32]  S. Scott,et al.  Cortical control of reaching movements , 1997, Current Opinion in Neurobiology.

[33]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[34]  T. Brown,et al.  Confirmatory Factor Analysis for Applied Research , 2006 .

[35]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[36]  Byron M. Yu,et al.  Mixture of Trajectory Models for Neural Decoding of Goal-directed Movements a Computational Model of Craving and Obsession Decoding Visual Inputs from Multiple Neurons in the Human Temporal Lobe Encoding Contribution of Individual Retinal Ganglion Cell Responses to Velocity and Acceleration , 2008 .

[37]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[38]  Byron M. Yu,et al.  Neural Variability in Premotor Cortex Provides a Signature of Motor Preparation , 2006, The Journal of Neuroscience.

[39]  R Caminiti,et al.  Making arm movements within different parts of space: the premotor and motor cortical representation of a coordinate system for reaching to visual targets , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  M S Graziano,et al.  Coding the locations of objects in the dark. , 1997, Science.

[41]  B L McNaughton,et al.  Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. , 1998, Journal of neurophysiology.

[42]  Zoubin Ghahramani,et al.  A Unifying Review of Linear Gaussian Models , 1999, Neural Computation.

[43]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[44]  R. Lemon,et al.  The involvement of monkey premotor cortex neurones in preparation of visually cued arm movements , 1985, Behavioural Brain Research.

[45]  D. Boussaoud,et al.  Gaze effects in the cerebral cortex: reference frames for space coding and action , 1999, Experimental Brain Research.

[46]  J. A. Wilson,et al.  Two-dimensional movement control using electrocorticographic signals in humans , 2008, Journal of neural engineering.

[47]  S. Meagher Instant neural control of a movement signal , 2002 .

[48]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[49]  RP Dum,et al.  Topographic organization of corticospinal projections from the frontal lobe: motor areas on the lateral surface of the hemisphere , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[50]  Byron M. Yu,et al.  Detecting neural-state transitions using hidden Markov models for motor cortical prostheses. , 2008, Journal of neurophysiology.

[51]  Sam T. Roweis,et al.  EM Algorithms for PCA and SPCA , 1997, NIPS.

[52]  Alexandre Pouget,et al.  Optimal Sensorimotor Integration in Recurrent Cortical Networks: A Neural Implementation of Kalman Filters , 2007, The Journal of Neuroscience.

[53]  R E Kass,et al.  Recursive bayesian decoding of motor cortical signals by particle filtering. , 2004, Journal of neurophysiology.

[54]  Wei Wu,et al.  Coordinate system representations of movement direction in the premotor cortex , 2007, Experimental Brain Research.

[55]  Alexandre Pouget,et al.  A computational perspective on the neural basis of multisensory spatial representations , 2002, Nature Reviews Neuroscience.

[56]  S.I. Ryu,et al.  An extensible infrastructure for fully automated spike sorting during online experiments , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[57]  John P. Cunningham,et al.  Toward Optimal Estimates of Neural Firing Rates from Spike Trains , 2008 .

[58]  Vikash Gilja,et al.  Toward optimal target placement for neural prosthetic devices. , 2008, Journal of neurophysiology.

[59]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[60]  R A Andersen,et al.  Influence of gaze rotation on the visual response of primate MSTd neurons. , 1999, Journal of neurophysiology.

[61]  J. Anthony Movshon,et al.  Comparison of Recordings from Microelectrode Arrays and Single Electrodes in the Visual Cortex , 2007, The Journal of Neuroscience.

[62]  J. Kalaska,et al.  Covariation of primate dorsal premotor cell activity with direction and amplitude during a memorized-delay reaching task. , 2000, Journal of neurophysiology.

[63]  C. Gross,et al.  Coding of visual space by premotor neurons. , 1994, Science.

[64]  Alexa Riehle,et al.  Are extent and force independent movement parameters? Preparation- and movement-related neuronal activity in the monkey cortex , 2004, Experimental Brain Research.

[65]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[66]  Geoffrey E. Hinton,et al.  The EM algorithm for mixtures of factor analyzers , 1996 .

[67]  Byron M. Yu,et al.  Extracting Dynamical Structure Embedded in Neural Activity , 2005, NIPS.

[68]  L. Paninski,et al.  Neural decoding of goal-directed movements using a linear state-space model with hidden states , 2007 .

[69]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[70]  Brian Everitt,et al.  An Introduction to Latent Variable Models , 1984 .

[71]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[72]  J. Herson,et al.  Square Root Transformation Revisited , 1972 .

[73]  D. Boussaoud Primate premotor cortex: modulation of preparatory neuronal activity by gaze angle. , 1995, Journal of neurophysiology.

[74]  R. Andersen,et al.  Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP. , 1996, Journal of neurophysiology.

[75]  D. Hoffman,et al.  Muscle and movement representations in the primary motor cortex. , 1999, Science.

[76]  D. Hoffman,et al.  Differential effects of muscimol microinjection into dorsal and ventral aspects of the premotor cortex of monkeys. , 1994, Journal of neurophysiology.

[77]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[78]  I. Darian‐Smith,et al.  Multiple corticospinal neuron populations in the macaque monkey are specified by their unique cortical origins, spinal terminations, and connections. , 1994, Cerebral cortex.

[79]  S.I. Ryu,et al.  Cortical Neural Prosthesis Performance Improves When Eye Position Is Monitored , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[80]  Gopal Santhanam,et al.  Factor Analysis with Poisson Output , 2006 .

[81]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[82]  K. Shenoy,et al.  A Central Source of Movement Variability , 2006, Neuron.

[83]  A. Riehle,et al.  The predictive value for performance speed of preparatory changes in neuronal activity of the monkey motor and premotor cortex , 1993, Behavioural Brain Research.

[84]  J. Donoghue,et al.  Neuronal Interactions Improve Cortical Population Coding of Movement Direction , 1999, The Journal of Neuroscience.

[85]  Bruno A. Olshausen,et al.  Book Review , 2003, Journal of Cognitive Neuroscience.

[86]  J. B. Preston,et al.  Interconnections between the prefrontal cortex and the premotor areas in the frontal lobe , 1994, The Journal of comparative neurology.

[87]  T. Ebner,et al.  Representation of accuracy in the dorsal premotor cortex , 2000, The European journal of neuroscience.

[88]  S. Scott,et al.  Reaching movements with similar hand paths but different arm orientations. II. Activity of individual cells in dorsal premotor cortex and parietal area 5. , 1997, Journal of neurophysiology.

[89]  Byron M. Yu,et al.  Trial - by - trial mean normalization improves plan period reach target decoding , 2005 .

[90]  N. Thacker,et al.  The Effects of a Square Root Transform on a Poisson Distributed Quantity , 2009 .

[91]  Alexandre Pouget,et al.  Computational approaches to sensorimotor transformations , 2000, Nature Neuroscience.

[92]  J. Kalaska,et al.  A comparison of movement direction-related versus load direction- related activity in primate motor cortex, using a two-dimensional reaching task , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[93]  Kisou Kubota,et al.  Cortical projection to hand-arm motor area from post-arcuate area in macaque monkeys: A histological study of retrograde transport of horseradish peroxidase , 1979, Neuroscience Letters.

[94]  P. Strick,et al.  Frontal Lobe Inputs to the Digit Representations of the Motor Areas on the Lateral Surface of the Hemisphere , 2005, The Journal of Neuroscience.

[95]  F Bremmer,et al.  Eye position effects on the neuronal activity of dorsal premotor cortex in the macaque monkey. , 1998, Journal of neurophysiology.

[96]  R. Andersen,et al.  Neural prosthetic control signals from plan activity , 2003, Neuroreport.

[97]  F. Bremmer,et al.  Spatial invariance of visual receptive fields in parietal cortex neurons , 1997, Nature.

[98]  P. Strick,et al.  Imaging the premotor areas , 2001, Current Opinion in Neurobiology.

[99]  E. Fetz,et al.  Long-term motor cortex plasticity induced by an electronic neural implant , 2006, Nature.

[100]  RP Dum,et al.  The origin of corticospinal projections from the premotor areas in the frontal lobe , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[101]  Rajat Raina,et al.  Classification with Hybrid Generative/Discriminative Models , 2003, NIPS.

[102]  M. Wilson,et al.  Analyzing Functional Connectivity Using a Network Likelihood Model of Ensemble Neural Spiking Activity , 2005, Neural Computation.

[103]  C. Gross,et al.  Visuospatial properties of ventral premotor cortex. , 1997, Journal of neurophysiology.

[104]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[105]  T. Ebner,et al.  Neuronal specification of direction and distance during reaching movements in the superior precentral premotor area and primary motor cortex of monkeys. , 1993, Journal of neurophysiology.

[106]  John P. Cunningham,et al.  Single-Neuron Stability during Repeated Reaching in Macaque Premotor Cortex , 2007, The Journal of Neuroscience.

[107]  Richard A. Andersen,et al.  Separate body- and world-referenced representations of visual space in parietal cortex , 1998, Nature.

[108]  John F. Kalaska,et al.  Neural correlates of mental rehearsal in dorsal premotor cortex , 2004, Nature.

[109]  Teresa H. Y. Meng,et al.  HermesB: A Continuous Neural Recording System for Freely Behaving Primates , 2007, IEEE Transactions on Biomedical Engineering.

[110]  R. Andersen,et al.  Reaches to Sounds Encoded in an Eye-Centered Reference Frame , 2000, Neuron.

[111]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[112]  Gopal Santhanam,et al.  Preparatory activity in premotor and motor cortex reflects the speed of the upcoming reach. , 2006, Journal of neurophysiology.