Challenges and Opportunities for Next-Generation Intracortically Based Neural Prostheses

Neural prosthetic systems aim to help disabled patients by translating neural signals from the brain into control signals for guiding computer cursors, prosthetic arms, and other assistive devices. Intracortical electrode arrays measure action potentials and local field potentials from individual neurons, or small populations of neurons, in the motor cortices and can provide considerable information for controlling prostheses. Despite several compelling proof-of-concept laboratory animal experiments and an initial human clinical trial, at least three key challenges remain which, if left unaddressed, may hamper the translation of these systems into widespread clinical use. We review these challenges: achieving able-bodied levels of performance across tasks and across environments, achieving robustness across multiple decades, and restoring able-bodied quality proprioception and somatosensation. We also describe some emerging opportunities for meeting these challenges. If these challenges can be largely or fully met, intracortically based neural prostheses may achieve true clinical viability and help increasing numbers of disabled patients.

[1]  Thomas Green,et al.  An In-Depth Look into the Text Entry User Experience on the iPhone , 2008 .

[2]  Jacob G. Bernstein,et al.  Millisecond-Timescale Optical Control of Neural Dynamics in the Nonhuman Primate Brain , 2009, Neuron.

[3]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[4]  G. Schalk,et al.  Evolution of brain-computer interfaces : going beyond classic motor physiology , 2009 .

[5]  Teresa H. Meng,et al.  Optimizing spike sorting for brain computer interfaces with non-stationary waveforms , 2007 .

[6]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[7]  Michael J. Black,et al.  Closed-loop neural control of cursor motion using a Kalman filter , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Vikash Gilja,et al.  Long-term Stability of Neural Prosthetic Control Signals from Silicon Cortical Arrays in Rhesus Macaque Motor Cortex , 2010 .

[9]  K. Anderson Targeting recovery: priorities of the spinal cord-injured population. , 2004, Journal of neurotrauma.

[10]  Nicholas G Hatsopoulos,et al.  Incorporating Feedback from Multiple Sensory Modalities Enhances Brain–Machine Interface Control , 2010, The Journal of Neuroscience.

[11]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[12]  R. Andersen,et al.  Neural prosthetic control signals from plan activity , 2003, Neuroreport.

[13]  Teresa H. Y. Meng,et al.  Model-based neural decoding of reaching movements: a maximum likelihood approach , 2004, IEEE Transactions on Biomedical Engineering.

[14]  Michael J. Black,et al.  Modeling and decoding motor cortical activity using a switching Kalman filter , 2004, IEEE Transactions on Biomedical Engineering.

[15]  Steven M Chase,et al.  Control of a brain–computer interface without spike sorting , 2009, Journal of neural engineering.

[16]  A. Abbott Neuroprosthetics: In search of the sixth sense , 2006, Nature.

[17]  Michael J. Black,et al.  Decoding Complete Reach and Grasp Actions from Local Primary Motor Cortex Populations , 2010, The Journal of Neuroscience.

[18]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[19]  Emilio Salinas,et al.  Cognitive neuroscience: Flutter Discrimination: neural codes, perception, memory and decision making , 2003, Nature Reviews Neuroscience.

[20]  Richard A Andersen,et al.  Decoding Trajectories from Posterior Parietal Cortex Ensembles , 2008, The Journal of Neuroscience.

[21]  Miguel A. L. Nicolelis,et al.  Principles of neural ensemble physiology underlying the operation of brain–machine interfaces , 2009, Nature Reviews Neuroscience.

[22]  S. Meagher Instant neural control of a movement signal , 2002 .

[23]  A. Zorzos,et al.  Multiwaveguide implantable probe for light delivery to sets of distributed brain targets. , 2010, Optics letters.

[24]  C. Ghez,et al.  Loss of proprioception produces deficits in interjoint coordination. , 1993, Journal of neurophysiology.

[25]  Philip N. Sabes,et al.  Multisensory Integration during Motor Planning , 2003, The Journal of Neuroscience.

[26]  Uri T Eden,et al.  General-purpose filter design for neural prosthetic devices. , 2007, Journal of neurophysiology.

[27]  S. Krishna High-performance continuous neural cursor control enabled by a feedback control perspective , 2010 .

[28]  Vikash Gilja,et al.  Autonomous head-mounted electrophysiology systems for freely behaving primates , 2010, Current Opinion in Neurobiology.

[29]  C. Schwarz,et al.  Spatiotemporal effects of microstimulation in rat neocortex: a parametric study using multielectrode recordings. , 2003, Journal of neurophysiology.

[30]  D.M. Taylor,et al.  Information conveyed through brain-control: cursor versus robot , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[32]  Byron M. Yu,et al.  Factor-analysis methods for higher-performance neural prostheses. , 2009, Journal of neurophysiology.

[33]  Matthew T. Kaufman,et al.  Cortical Preparatory Activity: Representation of Movement or First Cog in a Dynamical Machine? , 2010, Neuron.

[34]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[35]  Murtaza Z Mogri,et al.  Optical Deconstruction of Parkinsonian Neural Circuitry , 2009, Science.

[36]  Patrick Degenaar,et al.  Multi-site optical excitation using ChR2 and micro-LED array , 2010, Journal of neural engineering.

[37]  Vikash Gilja,et al.  A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces. , 2011, Journal of neurophysiology.

[38]  Byron M. Yu,et al.  Mixture of Trajectory Models for Neural Decoding of Goal-directed Movements a Computational Model of Craving and Obsession Decoding Visual Inputs from Multiple Neurons in the Human Temporal Lobe Encoding Contribution of Individual Retinal Ganglion Cell Responses to Velocity and Acceleration , 2008 .

[39]  K. Deisseroth,et al.  Molecular and Cellular Approaches for Diversifying and Extending Optogenetics , 2010, Cell.

[40]  Byron M. Yu,et al.  Detecting neural-state transitions using hidden Markov models for motor cortical prostheses. , 2008, Journal of neurophysiology.

[41]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[42]  Matthew T. Kaufman,et al.  An optogenetic toolbox designed for primates , 2011, Nature Neuroscience.

[43]  R.R. Harrison,et al.  HermesC: Low-Power Wireless Neural Recording System for Freely Moving Primates , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  K. Deisseroth,et al.  Neural substrates of awakening probed with optogenetic control of hypocretin neurons , 2007, Nature.

[45]  Jose M. Carmena,et al.  Learning in Closed-Loop Brain–Machine Interfaces: Modeling and Experimental Validation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[46]  Shamim Nemati,et al.  Biomimetic Brain Machine Interfaces for the Control of Movement , 2007, The Journal of Neuroscience.

[47]  K. Deisseroth,et al.  Millisecond-timescale, genetically targeted optical control of neural activity , 2005, Nature Neuroscience.

[48]  S.I. Ryu,et al.  Cortical Neural Prosthesis Performance Improves When Eye Position Is Monitored , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  John P. Cunningham,et al.  Methods for estimating neural firing rates, and their application to brain-machine interfaces , 2009, Neural Networks.

[50]  Byron M. Yu,et al.  Neural Decoding for Motor and Communication Prostheses , 2010 .

[51]  John P. Cunningham,et al.  Neural prosthetic systems: Current problems and future directions , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[52]  M. Moffitt,et al.  Model-based analysis of cortical recording with silicon microelectrodes , 2005, Clinical Neurophysiology.

[53]  R. Andersen,et al.  Cognitive neural prosthetics. , 2010, Annual review of psychology.

[54]  R. Andersen,et al.  Cortical Local Field Potential Encodes Movement Intentions in the Posterior Parietal Cortex , 2005, Neuron.

[55]  R. Reid,et al.  Direct Activation of Sparse, Distributed Populations of Cortical Neurons by Electrical Microstimulation , 2009, Neuron.

[56]  B. Connors,et al.  Integrated device for optical stimulation and spatiotemporal electrical recording of neural activity in light-sensitized brain tissue , 2009, Journal of neural engineering.

[57]  L. Miller,et al.  Electrical Stimulation of the Proprioceptive Cortex (Area 3a) Used to Instruct a Behaving Monkey , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[58]  S. O'Driscoll,et al.  Neurons to Silicon: Implantable Prosthesis Processor , 2006, 2006 IEEE International Solid State Circuits Conference - Digest of Technical Papers.

[59]  John P. Cunningham,et al.  Neural Decoding of Movements: From Linear to Nonlinear Trajectory Models , 2007, ICONIP.

[60]  K.V. Shenoy,et al.  Power feasibility of implantable digital spike sorting circuits for neural prosthetic systems , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[61]  Jose M Carmena,et al.  Invasive or noninvasive: understanding brain-machine interface technology. , 2010, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[62]  Miguel A. L. Nicolelis,et al.  A Brain-Machine Interface Instructed by Direct Intracortical Microstimulation , 2009, Front. Integr. Neurosci..

[63]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[64]  R. Romo,et al.  Neural codes for perceptual discrimination in primary somatosensory cortex , 2005, Nature Neuroscience.

[65]  J. Kalaska,et al.  Learning to Move Machines with the Mind , 2022 .

[66]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[67]  Reid R. Harrison,et al.  The Design of Integrated Circuits to Observe Brain Activity , 2008, Proceedings of the IEEE.

[68]  N A Fitzsimmons,et al.  Primate Reaching Cued by Multichannel Spatiotemporal Cortical Microstimulation , 2007, The Journal of Neuroscience.

[69]  Afsheen Afshar,et al.  Free-paced high-performance brain-computer interfaces. , 2007, Journal of neural engineering.

[70]  Robert E. Kass,et al.  Comparison of brain–computer interface decoding algorithms in open-loop and closed-loop control , 2010, Journal of Computational Neuroscience.

[71]  Daniel Moran,et al.  Evolution of brain–computer interface: action potentials, local field potentials and electrocorticograms , 2010, Current Opinion in Neurobiology.

[72]  F. Solzbacher,et al.  Integrated wireless neural interface based on the Utah electrode array , 2009, Biomedical microdevices.

[73]  V. Gilja,et al.  Signal Processing Challenges for Neural Prostheses , 2008, IEEE Signal Processing Magazine.

[74]  Ming Yin,et al.  Listening to Brain Microcircuits for Interfacing With External World—Progress in Wireless Implantable Microelectronic Neuroengineering Devices , 2010, Proceedings of the IEEE.

[75]  K. Deisseroth,et al.  Parvalbumin neurons and gamma rhythms enhance cortical circuit performance , 2009, Nature.

[76]  Lizzie Buchen Neuroscience: Illuminating the brain , 2010, Nature.

[77]  Krishna V Shenoy,et al.  Human cortical prostheses: lost in translation? , 2009, Neurosurgical focus.

[78]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[79]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[80]  Hansjörg Scherberger,et al.  Neural control of motor prostheses , 2009, Current Opinion in Neurobiology.

[81]  Feng Zhang,et al.  Multimodal fast optical interrogation of neural circuitry , 2007, Nature.

[82]  P V Bayly,et al.  Deformation of the human brain induced by mild acceleration. , 2005, Journal of neurotrauma.

[83]  Robert E. Kass,et al.  2009 Special Issue: Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain-computer interface algorithms , 2009 .

[84]  R G Radwin,et al.  Evaluation of a modified Fitts law brain–computer interface target acquisition task in able and motor disabled individuals , 2009, Journal of neural engineering.

[85]  Vikash Gilja,et al.  Toward optimal target placement for neural prosthetic devices. , 2008, Journal of neurophysiology.

[86]  Teresa H. Y. Meng,et al.  HermesB: A Continuous Neural Recording System for Freely Behaving Primates , 2007, IEEE Transactions on Biomedical Engineering.

[87]  Nicholas G Hatsopoulos,et al.  The science of neural interface systems. , 2009, Annual review of neuroscience.