Computing Arm Movements with a Monkey Brainet

Traditionally, brain-machine interfaces (BMIs) extract motor commands from a single brain to control the movements of artificial devices. Here, we introduce a Brainet that utilizes very-large-scale brain activity (VLSBA) from two (B2) or three (B3) nonhuman primates to engage in a common motor behaviour. A B2 generated 2D movements of an avatar arm where each monkey contributed equally to X and Y coordinates; or one monkey fully controlled the X-coordinate and the other controlled the Y-coordinate. A B3 produced arm movements in 3D space, while each monkey generated movements in 2D subspaces (X-Y, Y-Z, or X-Z). With long-term training we observed increased coordination of behavior, increased correlations in neuronal activity between different brains, and modifications to neuronal representation of the motor plan. Overall, performance of the Brainet improved owing to collective monkey behaviour. These results suggest that primate brains can be integrated into a Brainet, which self-adapts to achieve a common motor goal.

[1]  P. R. Laughlin,et al.  Groups perform better than the best individuals on letters-to-numbers problems: effects of group size. , 2006, Journal of personality and social psychology.

[2]  Eduard R. Soudijn,et al.  SCANNING ELECTRON-MICROSCOPIC STUDY OF ORGAN OF CORTI IN NORMAL AND SOUND-DAMAGED GUINEA-PIGS , 1976 .

[3]  S. Yoo,et al.  Non-Invasive Brain-to-Brain Interface (BBI): Establishing Functional Links between Two Brains , 2013, PloS one.

[4]  N. Sebanz,et al.  Psychological research on joint action: Theory and data , 2011 .

[5]  Tzyy-Ping Jung,et al.  A Collaborative Brain-Computer Interface for Improving Human Performance , 2011, PloS one.

[6]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[7]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[8]  Michael J. Richardson,et al.  Contrasting Approaches to Perceiving and Acting With Others , 2006 .

[9]  Craig K. Abbey,et al.  Neural decoding of collective wisdom with multi-brain computing , 2012, NeuroImage.

[10]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[12]  Michael J. Richardson,et al.  Rocking together: dynamics of intentional and unintentional interpersonal coordination. , 2007, Human movement science.

[13]  Joseph E. O’Doherty,et al.  Unscented Kalman Filter for Brain-Machine Interfaces , 2009, PloS one.

[14]  N Marangos,et al.  COCHLEAR IMPLANTS , 1976, The Lancet.

[15]  Ziv M. Williams,et al.  A cortical-spinal prosthesis for targeted limb movement in paralyzed primate avatars , 2014, Nature Communications.

[16]  Anton Nijholt,et al.  Evaluating a multi-player brain-computer interface game: Challenge versus co-experience , 2013, Entertain. Comput..

[17]  Miriam Zacksenhouse,et al.  Cortical Ensemble Adaptation to Represent Velocity of an Artificial Actuator Controlled by a Brain-Machine Interface , 2005, The Journal of Neuroscience.

[18]  Miguel A. L. Nicolelis,et al.  State-of-the-Art Microwire Array Design for Chronic Neural Recordings in Behaving Animals , 2008 .

[19]  P. Latham,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S11 References Movie S1 Optimally Interacting Minds R�ports , 2022 .

[20]  Á. Pascual-Leone,et al.  Conscious Brain-to-Brain Communication in Humans Using Non-Invasive Technologies , 2014, Brain Stimulation.

[21]  Margherita Antona,et al.  Universal Access in Human-Computer Interaction. Design Methods, Tools, and Interaction Techniques for eInclusion , 2013, Lecture Notes in Computer Science.

[22]  Nicolelis Mal,et al.  State-of-the-Art Microwire Array Design for Chronic Neural Recordings in Behaving Animals -- Methods for Neural Ensemble Recordings , 2008 .

[23]  Miguel A. L. Nicolelis,et al.  Extracting Kinematic Parameters for Monkey Bipedal Walking from Cortical Neuronal Ensemble Activity , 2009, Front. Integr. Neurosci..

[24]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[25]  Robert E. Hampson,et al.  Donor/recipient enhancement of memory in rat hippocampus , 2013, Front. Syst. Neurosci..

[26]  Solaiman Shokur,et al.  A Brain-Machine Interface Enables Bimanual Arm Movements in Monkeys , 2013, Science Translational Medicine.

[27]  Cordula Vesper,et al.  A minimal architecture for joint action , 2010, Neural Networks.

[28]  N. Kerr,et al.  Bias in judgment: Comparing individuals and groups. , 1996 .

[29]  Konrad P. Kording.  Faculty Opinions recommendation of Chronic, wireless recordings of large-scale brain activity in freely moving rhesus monkeys. , 2014 .

[30]  Paul Root Wolpe,et al.  When “I” becomes “We”: ethical implications of emerging brain-to-brain interfacing technologies , 2014, Front. Neuroeng..

[31]  N. Sebanz,et al.  Evolving intentions for social interaction: from entrainment to joint action , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[32]  Tzyy-Ping Jung,et al.  A Collaborative Brain-Computer Interface for Accelerating Human Decision Making , 2013, HCI.

[33]  N. Kerr,et al.  Group performance and decision making. , 2004, Annual review of psychology.

[34]  Jerald D. Kralik,et al.  Chronic, multisite, multielectrode recordings in macaque monkeys , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[35]  N. Cohen,et al.  Cochlear Implants , 2000 .

[36]  Peter J. Ifft,et al.  Active tactile exploration enabled by a brain-machine-brain interface , 2011, Nature.

[37]  Eric E. Thomson,et al.  Perceiving Invisible Light through a Somatosensory Cortical Prosthesis , 2013, Nature Communications.

[38]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[39]  Rajesh P. N. Rao,et al.  Brain–computer interfaces: a powerful tool for scientific inquiry , 2014, Current Opinion in Neurobiology.

[40]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[41]  Miguel Nicolelis.  Beyond Boundaries: The New Neuroscience of Connecting Brains with Machines---and How It Will Change Our Lives , 2011 .

[42]  Mikhail A. Lebedev,et al.  Chronic, Wireless Recordings of Large Scale Brain Activity in Freely Moving Rhesus Monkeys , 2014, Nature Methods.

[43]  Riccardo Poli,et al.  Collaborative Brain-Computer Interface for Aiding Decision-Making , 2014, PloS one.

[44]  Jônatas Manzolli,et al.  Disembodied and Collaborative Musical Interaction in the Multimodal Brain Orchestra , 2010, NIME.

[45]  D. Heeger,et al.  Neurocinematics: The Neuroscience of Film , 2008 .

[46]  Michael J. Richardson,et al.  Judging and actualizing intrapersonal and interpersonal affordances. , 2007, Journal of experimental psychology. Human perception and performance.

[47]  Riccardo Poli,et al.  Towards cooperative brain-computer interfaces for space navigation , 2013, IUI '13.

[48]  Jing Wang,et al.  A Brain-to-Brain Interface for Real-Time Sharing of Sensorimotor Information , 2013, Scientific Reports.