Naïve coadaptive cortical control

The ability to control a prosthetic device directly from the neocortex has been demonstrated in rats, monkeys and humans. Here we investigate whether neural control can be accomplished in situations where (1) subjects have not received prior motor training to control the device (naive user) and (2) the neural encoding of movement parameters in the cortex is unknown to the prosthetic device (naive controller). By adopting a decoding strategy that identifies and focuses on units whose firing rate properties are best suited for control, we show that naive subjects mutually adapt to learn control of a neural prosthetic system. Six untrained Long-Evans rats, implanted with silicon micro-electrodes in the motor cortex, learned cortical control of an auditory device without prior motor characterization of the recorded neural ensemble. Single- and multi-unit activities were decoded using a Kalman filter to represent an audio "cursor" (90 ms tone pips ranging from 250 Hz to 16 kHz) which subjects controlled to match a given target frequency. After each trial, a novel adaptive algorithm trained the decoding filter based on correlations of the firing patterns with expected cursor movement. Each behavioral session consisted of 100 trials and began with randomized decoding weights. Within 7 +/- 1.4 (mean +/- SD) sessions, all subjects were able to significantly score above chance (P < 0.05, randomization method) in a fixed target paradigm. Training lasted 24 sessions in which both the behavioral performance and signal to noise ratio of the peri-event histograms increased significantly (P < 0.01, ANOVA). Two rats continued training on a more complex task using a bilateral, two-target control paradigm. Both subjects were able to significantly discriminate the target tones (P < 0.05, Z-test), while one subject demonstrated control above chance (P < 0.05, Z-test) after 12 sessions and continued improvement with many sessions achieving over 90% correct targets. Dynamic analysis of binary trial responses indicated that early learning for this subject occurred during session 6. This study demonstrates that subjects can learn to generate neural control signals that are well suited for use with external devices without prior experience or training.

[1]  Emery N Brown,et al.  Analysis and design of behavioral experiments to characterize population learning. , 2005, Journal of neurophysiology.

[2]  Matthew Fellows,et al.  On the variability of manual spike sorting , 2004, IEEE Transactions on Biomedical Engineering.

[3]  E.N. Brown,et al.  An analysis of hippocampal spatio-temporal representations using a Bayesian algorithm for neural spike train decoding , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[5]  James L Olds.  Operant conditioning of single unit responses. , 1965 .

[6]  R E Kass,et al.  Recursive bayesian decoding of motor cortical signals by particle filtering. , 2004, Journal of neurophysiology.

[7]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[8]  K. Horch,et al.  Effects of short-term training on sensory and motor function in severed nerves of long-term human amputees. , 2005, Journal of neurophysiology.

[9]  Michael J. Black,et al.  A quantitative comparison of linear and non-linear models of motor cortical activity for the encoding and decoding of arm motions , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[10]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[11]  Sung June Kim,et al.  Superiority of nonlinear mapping in decoding multiple single-unit neuronal spike trains: A simulation study , 2006, Journal of Neuroscience Methods.

[12]  P R Kennedy,et al.  Direct control of a computer from the human central nervous system. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  Emery N. Brown,et al.  Dynamic Analysis of Neural Encoding by Point Process Adaptive Filtering , 2004, Neural Computation.

[14]  Justin C. Williams,et al.  Chronic neural recording using silicon-substrate microelectrode arrays implanted in cerebral cortex , 2004, IEEE Transactions on Biomedical Engineering.

[15]  C.R. Miller,et al.  Suitability of the Cingulate Cortex for Neural Control , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  R. J. Vetter,et al.  Silicon-substrate intracortical microelectrode arrays for long-term recording of neuronal spike activity in cerebral cortex , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  E. Halgren,et al.  Motor-cortical activity in tetraplegics , 2001, Nature.

[18]  M. Abeles.  Quantification, smoothing, and confidence limits for single-units' histograms , 1982, Journal of Neuroscience Methods.

[19]  K. Åström.  Introduction to Stochastic Control Theory , 1970 .

[20]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Michael G. Lacourse,et al.  Cortical potentials during imagined movements in individuals with chronic spinal cord injuries , 1999, Behavioural Brain Research.

[22]  Melody Moore,et al.  Using human extra-cortical local field potentials to control a switch. , 2004, Journal of neural engineering.

[23]  D. G. Albrecht,et al.  Bayesian analysis of identification performance in monkey visual cortex: Nonlinear mechanisms and stimulus certainty , 1995, Vision Research.

[24]  Teresa H. Y. Meng,et al.  Model-based neural decoding of reaching movements: a maximum likelihood approach , 2004, IEEE Transactions on Biomedical Engineering.

[25]  R. Andersen,et al.  Neural prosthetic control signals from plan activity , 2003, Neuroreport.

[26]  Michael J. Black,et al.  Modeling and decoding motor cortical activity using a switching Kalman filter , 2004, IEEE Transactions on Biomedical Engineering.

[27]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[28]  D. Kipke,et al.  Long-term neural recording characteristics of wire microelectrode arrays implanted in cerebral cortex. , 1999, Brain research. Brain research protocols.

[29]  P. Brown,et al.  Synchronous unit activity and local field potentials evoked in the subthalamic nucleus by cortical stimulation. , 2004, Journal of neurophysiology.

[30]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[31]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[32]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[33]  Gary E. Birch,et al.  A brain-controlled switch for asynchronous control applications , 2000, IEEE Trans. Biomed. Eng..

[34]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[35]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[36]  Emery N Brown,et al.  Dynamic Analysis of Learning in Behavioral Experiments , 2004, The Journal of Neuroscience.

[37]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[38]  J. Si,et al.  Closed-loop cortical control of direction using support vector machines , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  M S Lewicki,et al.  A review of methods for spike sorting: the detection and classification of neural action potentials. , 1998, Network.

[40]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[41]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. III. Positional gradients and population coding of movement direction from various movement origins , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[42]  E. Fetz.  Operant Conditioning of Cortical Unit Activity , 1969, Science.

[43]  E. Fetz,et al.  Operant Conditioning of Specific Patterns of Neural and Muscular Activity , 1971, Science.

[44]  J. Donoghue,et al.  Neuronal Interactions Improve Cortical Population Coding of Movement Direction , 1999, The Journal of Neuroscience.

[45]  Jeannine S. Schiller,et al.  Summary health statistics for U.S. adults: National Health Interview Survey, 2001. , 2004, Vital and health statistics. Series 10, Data from the National Health Survey.

[46]  Greg Welch,et al.  An Introduction to Kalman Filter , 1995, SIGGRAPH 2001.

[47]  S. Meagher.  Instant neural control of a movement signal , 2002 .

[48]  Edward M. Schmidt,et al.  Single neuron recording from motor cortex as a possible source of signals for control of external devices , 2006, Annals of Biomedical Engineering.

[49]  D R Humphrey,et al.  Predicting Measures of Motor Performance from Multiple Cortical Spike Trains , 1970, Science.

[50]  Jerald D. Kralik,et al.  Chronic, multisite, multielectrode recordings in macaque monkeys , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[51]  G. Pfurtscheller,et al.  Conversion of EEG activity into cursor movement by a brain-computer interface (BCI) , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  José Carlos Príncipe,et al.  Ascertaining the importance of neurons to develop better brain-machine interfaces , 2004, IEEE Transactions on Biomedical Engineering.

[53]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  T. Sanger,et al.  Probability density estimation for the interpretation of neural population codes. , 1996, Journal of neurophysiology.

[55]  David R. Thomas,et al.  Stimulus generalization gradients for auditory intensity in rats and guinea pigs , 1972 .

[56]  L. Paninski,et al.  Spatiotemporal tuning of motor cortical neurons for hand position and velocity. , 2004, Journal of neurophysiology.

[57]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. I. Relations between single cell discharge and direction of movement , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[58]  R A Normann,et al.  Trial-by-trial discrimination of three enantiomer pairs by neural ensembles in mammalian olfactory bulb. , 2006, Journal of neurophysiology.

[59]  A. P. Georgopoulos,et al.  Variability and Correlated Noise in the Discharge of Neurons in Motor and Parietal Areas of the Primate Cortex , 1998, The Journal of Neuroscience.