Brain-Machine Interfaces: From Macro- to Microcircuits

Brain-machine interfaces (BMIs) establish unidirectional and bidirectional communication channels between the brain and assistive devices, such as wheelchairs, limb prostheses and computers. BMI technologies can also link areas within the brain and even individual brains. BMI approach holds promise to provide effective treatment for a range of neurological conditions. Moreover, BMIs can be utilized to augment brain function in healthy individuals. Here we consider three broadly defined BMI types: motor, sensory and cognitive. For these BMI types, both noninvasive and invasive methods have been employed for neural recordings and stimulation. While original BMIs were implemented at the level of brain macrocircuits, a recent trend was to develop BMIs that utilize neuronal microcircuits.

[1]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[2]  Miguel A. L. Nicolelis,et al.  Actions from thoughts , 2001, Nature.

[3]  Solaiman Shokur,et al.  A Brain-Machine Interface Enables Bimanual Arm Movements in Monkeys , 2013, Science Translational Medicine.

[4]  Miguel A. L. Nicolelis,et al.  Principles of neural ensemble physiology underlying the operation of brain–machine interfaces , 2009, Nature Reviews Neuroscience.

[5]  Miguel Nicolelis.  Beyond Boundaries: The New Neuroscience of Connecting Brains with Machines---and How It Will Change Our Lives , 2011 .

[6]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[7]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Dean J Krusienski,et al.  Brain-computer interface signal processing at the Wadsworth Center: mu and sensorimotor beta rhythms. , 2006, Progress in brain research.

[9]  F. Lacquaniti,et al.  From Spinal Central Pattern Generators to Cortical Network: Integrated BCI for Walking Rehabilitation , 2012, Neural plasticity.

[10]  S. Scott,et al.  Cortical control of reaching movements , 1997, Current Opinion in Neurobiology.

[11]  L. Cohen,et al.  Brain–computer interface in paralysis , 2008, Current opinion in neurology.

[12]  A. Schwartz,et al.  Behavioral and neural correlates of visuomotor adaptation observed through a brain-computer interface in primary motor cortex. , 2012, Journal of neurophysiology.

[13]  E. Evarts.  Motor Cortex Reflexes Associated with Learned Movement , 1973, Science.

[14]  C. Sherrington.  Integrative Action of the Nervous System , 1907 .

[15]  S. Bressler,et al.  Cognit activation: a mechanism enabling temporal integration in working memory , 2012, Trends in Cognitive Sciences.

[16]  Robert E. Hampson,et al.  Neural Activity in Frontal Cortical Cell Layers: Evidence for Columnar Sensorimotor Processing , 2011, Journal of Cognitive Neuroscience.

[17]  G. Holmes,et al.  Sensory disturbances from cerebral lesions , 1911 .

[18]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[19]  R. Shannon.  Advances in auditory prostheses. , 2012, Current opinion in neurology.

[20]  Theodore W Berger,et al.  A cortical neural prosthesis for restoring and enhancing memory , 2011, Journal of neural engineering.

[21]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[22]  D. V. van Essen,et al.  The pattern of interhemispheric connections and its relationship to extrastriate visual areas in the macaque monkey , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  Blake S. Wilson,et al.  Cochlear implants: A remarkable past and a brilliant future , 2008, Hearing Research.

[24]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[25]  M. Mladejovsky,et al.  Artificial Vision for the Blind: Electrical Stimulation of Visual Cortex Offers Hope for a Functional Prosthesis , 1974, Science.

[26]  Nicholas G Hatsopoulos,et al.  The science of neural interface systems. , 2009, Annual review of neuroscience.

[27]  Niels Birbaumer,et al.  Hemodynamic brain-computer interfaces for communication and rehabilitation , 2009, Neural Networks.

[28]  A. G. Feldman,et al.  Recent Tests of the Equilibrium-Point Hypothesis (λ Model) , 1998 .

[29]  M A Lebedev,et al.  A comparison of optimal MIMO linear and nonlinear models for brain–machine interfaces , 2006, Journal of neural engineering.

[30]  R. Romo,et al.  From sensation to action , 2002, Behavioural Brain Research.

[31]  V. Mountcastle.  The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[32]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[33]  Jaime Gómez Gil,et al.  Brain Computer Interfaces, a Review , 2012, Sensors.

[34]  Christine M Constantinople,et al.  Deep Cortical Layers Are Activated Directly by Thalamus , 2013, Science.

[35]  Ming Yin,et al.  Listening to Brain Microcircuits for Interfacing With External World—Progress in Wireless Implantable Microelectronic Neuroengineering Devices , 2010, Proceedings of the IEEE.

[36]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[37]  Lucas M. Santos,et al.  Facilitation and restoration of cognitive function in primate prefrontal cortex by a neuroprosthesis that utilizes minicolumn-specific neural firing , 2012, Journal of neural engineering.

[38]  Edward M. Schmidt,et al.  Single neuron recording from motor cortex as a possible source of signals for control of external devices , 2006, Annals of Biomedical Engineering.

[39]  P. Guertin.  The mammalian central pattern generator for locomotion , 2009, Brain Research Reviews.

[40]  Lynette A Jones,et al.  Tactile communication systems optimizing the display of information. , 2011, Progress in brain research.

[41]  Ioan Opris,et al.  Inter-laminar microcircuits across neocortex: repair and augmentation , 2013, Front. Syst. Neurosci..

[42]  P. Kennedy,et al.  Restoration of neural output from a paralyzed patient by a direct brain connection , 1998, Neuroreport.

[43]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[44]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[45]  G. Schott.  Penfield's homunculus: a note on cerebral cartography. , 1993, Journal of neurology, neurosurgery, and psychiatry.

[46]  G. Pfurtscheller,et al.  ‘Thought’ – control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia , 2003, Neuroscience Letters.

[47]  Martha J. Farah,et al.  Emerging ethical issues in neuroscience , 2002, Nature Neuroscience.

[48]  Jonathan R Wolpaw,et al.  A brain-computer interface for long-term independent home use , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[49]  David Sussillo,et al.  A recurrent neural network for closed-loop intracortical brain–machine interface decoders , 2012, Journal of neural engineering.

[50]  Robert Leeb,et al.  Towards natural non-invasive hand neuroprostheses for daily living , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[51]  Joel Davis.  Brain and Visual Perception: The Story of a 25-Year Collaboration , 2004 .

[52]  Gernot R. Müller-Putz,et al.  Control of an Electrical Prosthesis With an SSVEP-Based BCI , 2008, IEEE Transactions on Biomedical Engineering.

[53]  R. Hampson,et al.  Closing the loop in primate prefrontal cortex: inter-laminar processing , 2012, Front. Neural Circuits.

[54]  D R Humphrey,et al.  Predicting Measures of Motor Performance from Multiple Cortical Spike Trains , 1970, Science.

[55]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[56]  Joseph E. O’Doherty,et al.  Unscented Kalman Filter for Brain-Machine Interfaces , 2009, PloS one.

[57]  Klaus-Robert Müller,et al.  Playing Pinball with non-invasive BCI , 2008, NIPS.

[58]  R. Romo,et al.  Sensing without Touching Psychophysical Performance Based on Cortical Microstimulation , 2000, Neuron.

[59]  D. Buxhoeveden,et al.  The minicolumn hypothesis in neuroscience. , 2002, Brain : a journal of neurology.

[60]  Robert E. Hampson,et al.  Nonlinear modeling of neural population dynamics for hippocampal prostheses , 2009, Neural Networks.

[61]  E. Fetz.  Operant Conditioning of Cortical Unit Activity , 1969, Science.

[62]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[63]  L. Miller,et al.  Restoration of grasp following paralysis through brain-controlled stimulation of muscles , 2012, Nature.

[64]  J. Contreras-Vidal,et al.  Decoding Intra-Limb and Inter-Limb Kinematics During Treadmill Walking From Scalp Electroencephalographic (EEG) Signals , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[65]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[66]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[67]  A. Thomson,et al.  Interlaminar connections in the neocortex. , 2003, Cerebral cortex.

[68]  G. Brindley,et al.  The sensations produced by electrical stimulation of the visual cortex , 1968, The Journal of physiology.

[69]  Miguel A. L. Nicolelis,et al.  Extracting Kinematic Parameters for Monkey Bipedal Walking from Cortical Neuronal Ensemble Activity , 2009, Front. Integr. Neurosci..

[70]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[71]  K. Frank,et al.  LXII Some Approaches to the Technical Problem of Chronic Excitation of Peripheral Nerve , 1968, The Annals of otology, rhinology, and laryngology.

[72]  Vernon B. Mountcastle,et al.  The sensory hand : neural mechanisms of somatic sensation , 2005 .

[73]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[74]  M. Tanaka,et al.  Coding of modified body schema during tool use by macaque postcentral neurones. , 1996, Neuroreport.

[75]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[76]  Chin-Teng Lin,et al.  A Real-Time Wireless Brain–Computer Interface System for Drowsiness Detection , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[77]  Andrew B. Schwartz,et al.  Brain-Controlled Interfaces: Movement Restoration with Neural Prosthetics , 2006, Neuron.

[78]  M. Humayun,et al.  Artificial vision through neuronal stimulation , 2012, Neuroscience Letters.

[79]  Wolfgang Rosenstiel,et al.  An MEG-based brain–computer interface (BCI) , 2007, NeuroImage.

[80]  T.W. Berger,et al.  Restoring lost cognitive function , 2005, IEEE Engineering in Medicine and Biology Magazine.

[81]  Robert E. Hampson,et al.  Columnar Processing in Primate pFC: Evidence for Executive Control Microcircuits , 2012, Journal of Cognitive Neuroscience.

[82]  Miguel A. L. Nicolelis,et al.  A Brain-Machine Interface Instructed by Direct Intracortical Microstimulation , 2009, Front. Integr. Neurosci..

[83]  Miriam Zacksenhouse,et al.  Cortical Ensemble Adaptation to Represent Velocity of an Artificial Actuator Controlled by a Brain-Machine Interface , 2005, The Journal of Neuroscience.

[84]  Jason J S Barton,et al.  Disorder of higher visual function. , 2011, Current opinion in neurology.

[85]  K. Deisseroth,et al.  Circuit-breakers: optical technologies for probing neural signals and systems , 2007, Nature Reviews Neuroscience.

[86]  Paul J Cordo,et al.  Motor coordination can be fully understood only by studying complex movements. , 2004, Progress in brain research.

[87]  Robert E. Hampson,et al.  Prefrontal cortical recordings with biomorphic MEAs reveal complex columnar-laminar microcircuits for BCI/BMI implementation , 2015, Journal of Neuroscience Methods.

[88]  Hannes Bleuler,et al.  Active tactile exploration enabled by a brain-machine-brain interface , 2011, Nature.

[89]  R. Andersen,et al.  Cognitive neural prosthetics. , 2010, Annual review of psychology.

[90]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[91]  S. Solla,et al.  Toward the Restoration of Hand Use to a Paralyzed Monkey: Brain-Controlled Functional Electrical Stimulation of Forearm Muscles , 2009, PloS one.

[92]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[93]  M. Nicolelis,et al.  Cortical Modulations Increase in Early Sessions with Brain-Machine Interface , 2007, PloS one.

[94]  Ioan Opris,et al.  Prefrontal cortical minicolumn: from executive control to disrupted cognitive processing. , 2014, Brain : a journal of neurology.

[95]  S. Wise.  The primate premotor cortex: past, present, and preparatory. , 1985, Annual review of neuroscience.

[96]  N A Fitzsimmons,et al.  Primate Reaching Cued by Multichannel Spatiotemporal Cortical Microstimulation , 2007, The Journal of Neuroscience.

[97]  Igor A. Lavrov,et al.  Transformation of nonfunctional spinal circuits into functional states after the loss of brain input , 2009, Nature Neuroscience.

[98]  Dae C. Shin,et al.  Facilitation of memory encoding in primate hippocampus by a neuroprosthesis that promotes task-specific neural firing , 2013, Journal of neural engineering.

[99]  J. T. Massey,et al.  Mental rotation of the neuronal population vector. , 1989, Science.

[100]  Robert E. Hampson,et al.  Prefrontal cortical microcircuits bind perception to executive control , 2013, Scientific Reports.

[101]  David A. Steines,et al.  Ethical Issues in Brain–Computer Interface Research, Development, and Dissemination , 2012, Journal of neurologic physical therapy : JNPT.

[102]  Paul Bach-y-Rita,et al.  Brain plasticity: ‘visual’ acuity of blind persons via the tongue , 2001, Brain Research.

[103]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[104]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.