Building brain machine interfaces: From rat to monkey

Brain machine interfaces (BMIs), offer a direct path for brain to communicate with outside world, mainly use central neural activities to control artificial external devices. These techniques to collect the brain signals could be distinguished as non-invasive or invasive BMIs according to the position of recoding electrodes. Compared with non-invasive BMIs, invasive BMIs have wide potential in assisting, augmenting or repairing more complex motor functions of human, especially in patients with severe body paralysis. This paper will review our lab's research work on invasive BMIs with subjects on rat and monkey. We built a synchronous recording and analyzing system for rat's neural activities and motor behavior. Rat could use its intention to control external one dimensional robotic lever in real time. Also, a remote control training system was designed to realize rat navigating through 3D obstacle route, as well as switching between “motion” and “motionlessness” at any point during the route. We further extended our work to develop the invasive BMI system on non-human primate. While the monkey was trained to perform a 2-D center-out task, plenty of neural activities in motor cortex were invasively recorded. We showed the preliminary decoding results of the 2D trajectory, and plan to utilize the decoded prediction to control an external device, such as robot hand.

[1]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[2]  Mandayam A. Srinivasan,et al.  Continuous shared control for stabilizing reaching and grasping with brain-machine interfaces , 2006, IEEE Transactions on Biomedical Engineering.

[3]  Wei Wu,et al.  Neural Decoding of Cursor Motion Using a Kalman Filter , 2002, NIPS.

[4]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[5]  Miguel A. L. Nicolelis,et al.  A Brain-Machine Interface Instructed by Direct Intracortical Microstimulation , 2009, Front. Integr. Neurosci..

[6]  Peng Wang,et al.  A remote control training system for rat navigation in complicated environment , 2007 .

[7]  Jose M Carmena,et al.  Invasive or noninvasive: understanding brain-machine interface technology. , 2010, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[8]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[9]  Dragan F. Dimitrov,et al.  Cortical Representation of Ipsilateral Arm Movements in Monkey and Man , 2009, The Journal of Neuroscience.

[10]  Liam Paninski,et al.  Population decoding of motor cortical activity using a generalized linear model with hidden states , 2010, Journal of Neuroscience Methods.

[11]  Andrew B. Schwartz,et al.  Brain-Controlled Interfaces: Movement Restoration with Neural Prosthetics , 2006, Neuron.

[12]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[13]  Bagrat Amirikian,et al.  Directional tuning profiles of motor cortical cells , 2000, Neuroscience Research.

[14]  Michael J. Black,et al.  Assistive technology and robotic control using motor cortex ensemble‐based neural interface systems in humans with tetraplegia , 2007, The Journal of physiology.

[15]  Miguel A. L. Nicolelis,et al.  Principles of neural ensemble physiology underlying the operation of brain–machine interfaces , 2009, Nature Reviews Neuroscience.

[16]  S. Meagher.  Instant neural control of a movement signal , 2002 .

[17]  Daryl R Kipke,et al.  Development of Closed-Loop Neural Interface Technology in a Rat Model: Combining Motor Cortex Operant Conditioning With Visual Cortex Microstimulation , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Dennis A. Turner,et al.  The development of brain-machine interface neuroprosthetic devices , 2011, Neurotherapeutics.

[19]  P.R. Kennedy,et al.  Computer control using human intracortical local field potentials , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[21]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[22]  Shaomin Zhang,et al.  Real-time decoding algorithm in brain machine interfaces , 2010, IEEE/ICME International Conference on Complex Medical Engineering.

[23]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[24]  Shamim Nemati,et al.  Biomimetic Brain Machine Interfaces for the Control of Movement , 2007, The Journal of Neuroscience.

[25]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[26]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[27]  H. Poizner,et al.  Predicting Reaching Targets from Human EEG , 2008, IEEE Signal Processing Magazine.

[28]  Jia Jia,et al.  Using dlPAG-evoked immobile behavior in animal-robotics navigation , 2010, 2010 5th International Conference on Computer Science & Education.

[29]  John L Kubie,et al.  Telemetry system for reliable recording of action potentials from freely moving rats , 2002, Hippocampus.

[30]  G. Orban,et al.  Comparative mapping of higher visual areas in monkeys and humans , 2004, Trends in Cognitive Sciences.

[31]  Silvestro Micera,et al.  On the Shared Control of an EMG-Controlled Prosthetic Hand: Analysis of User–Prosthesis Interaction , 2008, IEEE Transactions on Robotics.

[32]  Parag G. Patil,et al.  Ensemble Recordings Of Human Subcortical Neurons as a Source Of Motor Control Signals For a Brain-Machine Interface , 2004, Neurosurgery.

[33]  Fan Zhou,et al.  Field-programmable gate array implementation of a probabilistic neural network for motor cortical decoding in rats , 2010, Journal of Neuroscience Methods.

[34]  Roman Rosipal,et al.  Overview and Recent Advances in Partial Least Squares , 2005, SLSFS.

[35]  Bin He,et al.  Relationship between speed and EEG activity during imagined and executed hand movements , 2010, Journal of neural engineering.

[36]  Yi Yu,et al.  Neural decoding based on probabilistic neural network , 2010, Journal of Zhejiang University SCIENCE B.

[37]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[38]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[39]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[40]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Shennan A. Weiss,et al.  Rat navigation guided by remote control , 2002 .