Interfacing a salamander brain with a salamander-like robot: Control of speed and direction with calcium signals from brainstem reticulospinal neurons

An important topic in designing neuroprosthetic devices for animals or patients with spinal cord injury is to find the right brain regions with which to interface the device. In vertebrates, an interesting target could be the reticulospinal (RS) neurons, which play a central role in locomotor control. These brainstem cells convey the locomotor commands to the spinal locomotor circuits that in turn generate the complex patterns of muscle contractions underlying locomotor movements. The RS neurons receive direct input from the Mesencephalic Locomotor Region (MLR), which controls locomotor initiation, maintenance, and termination, as well as locomotor speed. In addition, RS neurons convey turning commands to the spinal cord. In the context of interfacing neural networks and robotic devices, we explored in the present study whether the activity of salamander RS neurons could be used to control off-line, but in real time, locomotor speed and direction of a salamander robot. Using a salamander semi-intact preparation, we first provide evidence that stimulation of the RS cells on the left or right side evokes ipsilateral body bending, a crucial parameter involved during turning. We then identified the RS activity corresponding to these steering commands using calcium (Ca2+) imaging of RS neurons in an isolated brain preparation. Then, using a salamander robot controlled by a spinal cord model, we used the ratio of RS Ca2+ signals on left and right sides to control locomotion direction by modulating body bending. Moreover, we show that the robot locomotion speed can be controlled based on the amplitude of the Ca2+ response of RS cells, which is controlled by MLR stimulation strength as recently demonstrated in salamanders.

[1]  D. McLean,et al.  Selective Responses to Tonic Descending Commands by Temporal Summation in a Spinal Motor Pool , 2014, Neuron.

[2]  Yan Li,et al.  A Brain-Machine-Muscle Interface for Restoring Hindlimb Locomotion after Complete Spinal Transection in Rats , 2014, PloS one.

[3]  G. Roth,et al.  Morphology, axonal projection pattern, and response types of tectal neurons in plethodontid salamanders. II: Intracellular recording and labeling experiments , 1999, The Journal of comparative neurology.

[4]  T. Drew,et al.  Motor cortical activity during voluntary gait modifications in the cat. II. Cells related to the hindlimbs. , 1993, Journal of neurophysiology.

[5]  R. Dubuc,et al.  A Novel Neural Substrate for the Transformation of Olfactory Inputs into Motor Output , 2010, PLoS biology.

[6]  D. Ryczko,et al.  The multifunctional mesencephalic locomotor region. , 2013, Current pharmaceutical design.

[7]  Majid Sarrafzadeh,et al.  Forelimb EMG-based trigger to control an electronic spinal bridge to enable hindlimb stepping after a complete spinal cord lesion in rats , 2012, Journal of NeuroEngineering and Rehabilitation.

[8]  C. Naujoks-Manteuffel,et al.  Origins of descending projections to the medulla oblongata and rostral medulla spinalis in the urodeleSalamandra salamandra (amphibia) , 1988, The Journal of comparative neurology.

[9]  Aaron C. Koralek,et al.  Volitional modulation of optically recorded calcium signals during neuroprosthetic learning , 2014, Nature Neuroscience.

[10]  J. Cabelguen,et al.  Bimodal Locomotion Elicited by Electrical Stimulation of the Midbrain in the Salamander Notophthalmus viridescens , 2003, The Journal of Neuroscience.

[11]  R. Stein,et al.  Identification, Localization, and Modulation of Neural Networks for Walking in the Mudpuppy (Necturus Maculatus) Spinal Cord , 1998, The Journal of Neuroscience.

[12]  Auke Jan Ijspeert,et al.  From lamprey to salamander: an exploratory modeling study on the architecture of the spinal locomotor networks in the salamander , 2013, Biological Cybernetics.

[13]  D. Ryczko,et al.  The Transformation of a Unilateral Locomotor Command into a Symmetrical Bilateral Activation in the Brainstem , 2010, The Journal of Neuroscience.

[14]  S. Grillner Control of Locomotion in Bipeds, Tetrapods, and Fish , 1981 .

[15]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[16]  O. Marín,et al.  Descending supraspinal pathways in amphibians. I. A dextran amine tracing study of their cells of origin , 2001, The Journal of comparative neurology.

[17]  M. L. Shik,et al.  Behavior of hindbrain neurons during the transition from rest to evoked locomotion in a newt. , 1999, Progress in brain research.

[18]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[19]  A. Gamal,et al.  Miniaturized integration of a fluorescence microscope , 2011, Nature Methods.

[20]  Mikhail A Lebedev,et al.  Future developments in brain-machine interface research , 2011, Clinics.

[21]  J. Kalaska,et al.  Changes in the temporal pattern of primary motor cortex activity in a directional isometric force versus limb movement task. , 1998, Journal of neurophysiology.

[22]  Nalin Harischandra,et al.  A 3D Musculo-Mechanical Model of the Salamander for the Study of Different Gaits and Modes of Locomotion , 2010, Front. Neurorobot..

[23]  Dimitri Ryczko,et al.  Forebrain dopamine neurons project down to a brainstem region controlling locomotion , 2013, Proceedings of the National Academy of Sciences.

[24]  S. Gill,et al.  Bilateral deep brain stimulation of the pedunculopontine nucleus for Parkinson's disease , 2005, Neuroreport.

[25]  U. Norrsell,et al.  Behavioural repertory of cats without cerebral cortex from infancy , 1976, Experimental Brain Research.

[26]  A. Ijspeert,et al.  Segmental oscillators in axial motor circuits of the salamander: distribution and bursting mechanisms. , 2010, Journal of neurophysiology.

[27]  M. Schwab,et al.  Deep Brain Stimulation of the Midbrain Locomotor Region Improves Paretic Hindlimb Function After Spinal Cord Injury in Rats , 2013, Science Translational Medicine.

[28]  A. Ijspeert,et al.  Flexibility of the axial central pattern generator network for locomotion in the salamander. , 2015, Journal of neurophysiology.

[29]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[30]  Igor Kagan,et al.  How the mesencephalic locomotor region recruits hindbrain neurons. , 2004, Progress in brain research.

[31]  C. S. Hubbard,et al.  Brainstem reticulospinal neurons are targets for corticotropin-releasing factor-Induced locomotion in roughskin newts , 2010, Hormones and Behavior.

[32]  D. Ryczko,et al.  The mesencephalic locomotor region sends a bilateral glutamatergic drive to hindbrain reticulospinal neurons in a tetrapod , 2015, The Journal of comparative neurology.

[33]  J. Cabelguen,et al.  Fictive rhythmic motor patterns induced by NMDA in an in vitro brain stem-spinal cord preparation from an adult urodele. , 1999, Journal of neurophysiology.

[34]  J. Contreras-Vidal,et al.  Decoding Intra-Limb and Inter-Limb Kinematics During Treadmill Walking From Scalp Electroencephalographic (EEG) Signals , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  P. Stanzione,et al.  Implantation of human pedunculopontine nucleus: a safe and clinically relevant target in Parkinson's disease , 2005, Neuroreport.

[36]  Auke Jan Ijspeert,et al.  Inverse kinematics and reflex based controller for body-limb coordination of a salamander-like robot walking on uneven terrain , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[37]  Martin Wiesmann,et al.  Imaging human supraspinal locomotor centers in brainstem and cerebellum , 2008, NeuroImage.

[38]  R. Dubuc,et al.  Specific neural substrate linking respiration to locomotion , 2011, Proceedings of the National Academy of Sciences.

[39]  A. Ménard,et al.  Initiation of locomotion in lampreys , 2008, Brain Research Reviews.

[40]  S. Grillner,et al.  Tectal control of locomotion, steering, and eye movements in lamprey. , 2007, Journal of neurophysiology.

[41]  Shik Ml,et al.  Control of walking and running by means of electric stimulation of the midbrain , 1966 .

[42]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[43]  Karen A. Moxon,et al.  Decoding Hindlimb Movement for a Brain Machine Interface after a Complete Spinal Transection , 2012, PloS one.

[44]  S. Lehéricy,et al.  Cholinergic mesencephalic neurons are involved in gait and postural disorders in Parkinson disease. , 2010, The Journal of clinical investigation.

[45]  M. Kositsky,et al.  Dynamical dimension of a hybrid neurorobotic system , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Melina E. Hale,et al.  Grading Movement Strength by Changes in Firing Intensity versus Recruitment of Spinal Interneurons , 2007, Neuron.

[47]  A. Ijspeert,et al.  From Swimming to Walking with a Salamander Robot Driven by a Spinal Cord Model , 2007, Science.

[48]  C. Lowry,et al.  Corticotropin-Releasing Factor Enhances Locomotion and Medullary Neuronal Firing in an Amphibian , 1996, Hormones and Behavior.

[49]  Auke Jan Ijspeert,et al.  A salamander's flexible spinal network for locomotion, modeled at two levels of abstraction. , 2013, Integrative and comparative biology.

[50]  Miriam Zacksenhouse,et al.  Cortical Ensemble Adaptation to Represent Velocity of an Artificial Actuator Controlled by a Brain-Machine Interface , 2005, The Journal of Neuroscience.

[51]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[52]  Jiping He,et al.  Engineering Neural Interfaces for Rehabilitation of Lower Limb Function in Spinal Cord Injured , 2008, Proceedings of the IEEE.

[53]  S. Grillner,et al.  Activity of reticulospinal neurons during locomotion in the freely behaving lamprey. , 2000, Journal of neurophysiology.

[54]  R. Segev,et al.  How silent is the brain: is there a “dark matter” problem in neuroscience? , 2006, Journal of Comparative Physiology A.

[55]  Arun Ramakrishnan,et al.  Multiple Types of Movement-Related Information Encoded in Hindlimb/Trunk Cortex in Rats and Potentially Available for Brain–Machine Interface Controls , 2009, IEEE Transactions on Biomedical Engineering.

[56]  Tatiana G. Deliagina,et al.  Spinal and Supraspinal Control of the Direction of Stepping during Locomotion , 2012, The Journal of Neuroscience.

[57]  Auke Jan Ijspeert,et al.  A connectionist central pattern generator for the aquatic and terrestrial gaits of a simulated salamander , 2001, Biological Cybernetics.

[58]  S. Grillner,et al.  Lateral turns in the Lamprey. II. Activity of reticulospinal neurons during the generation of fictive turns. , 2001, Journal of neurophysiology.

[59]  Miguel A. L. Nicolelis,et al.  Extracting Kinematic Parameters for Monkey Bipedal Walking from Cortical Neuronal Ensemble Activity , 2009, Front. Integr. Neurosci..

[60]  T. Drew,et al.  Contributions of the motor cortex to the control of the hindlimbs during locomotion in the cat , 2002, Brain Research Reviews.

[61]  Michela Chiappalone,et al.  Computational analysis in vitro: dynamics and plasticity of a neuro-robotic system , 2005, Journal of neural engineering.