Control of a Robot Arm with Artificial and Biological Neural Networks

To perform research on learning in cultures of mouse neurons, a hardware and software system for interfacing a biological neuronal culture to a robot arm has been constructed. The software architecture is modular, which permits simulated neurons to be used in place of biological neurons. In both cases, the activity of the culture over time is represented as an activation vector that captures recent spatiotemporal patterns of neuron firing. The activation vector is converted into control signals for the arm in a manner that can be generalized to multiple degrees of freedom. Preliminary results from the system with both simulated and biological cultures are presented.

[1]  Thomas B. Shea.  Optimization of Neuronal-Computer Interface , 2009 .

[2]  E Ben-Jacob,et al.  Compact self-wiring in cultured neural networks , 2006, Journal of neural engineering.

[3]  Mary Guaraldi,et al.  Accelerated establishment of mature signaling patterns following stimulation of developing neuronal networks: “learning” versus “plasticity” , 2012, International Journal of Developmental Neuroscience.

[4]  Eshel Ben-Jacob,et al.  Generic modeling of chemotactic based self-wiring of neural networks , 1998, Neural Networks.

[5]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[6]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[7]  T.B. DeMarse,et al.  Adaptive flight control with living neuronal networks on microelectrode arrays , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[8]  Daniel A. Wagenaar,et al.  The Neurally Controlled Animat: Biological Brains Acting with Simulated Bodies , 2001, Auton. Robots.

[9]  Slawomir J. Nasuto,et al.  Controlling a mobile robot with a biological brain , 2010 .

[10]  Steve M. Potter,et al.  An extremely rich repertoire of bursting patterns during the development of cortical cultures , 2006, BMC Neuroscience.

[11]  Abraham Shultz,et al.  Modeling of the networking and activity of cultured mouse neurons for simulated experiments , 2013 .

[12]  Maria Gabriella Signorini,et al.  The estimation of long-term memory characteristics in MEA neuronal culture recordings , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[14]  David F. Meaney,et al.  Dynamic Changes in Neural Circuit Topology Following Mild Mechanical Injury In Vitro , 2011, Annals of Biomedical Engineering.

[15]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[16]  Vincent Torre,et al.  Toward the neurocomputer: image Processing and pattern recognition with neuronal cultures , 2005, IEEE Transactions on Biomedical Engineering.

[17]  Angela Tooker,et al.  Caged neuron MEA: A system for long-term investigation of cultured neural network connectivity , 2008, Journal of Neuroscience Methods.

[18]  Michael L. Anderson.  Embodied Cognition: A field guide , 2003, Artif. Intell..

[19]  Donald S. Fussell,et al.  Computer rendering of stochastic models , 1998 .

[20]  G. Edelman,et al.  Spike-timing dynamics of neuronal groups. , 2004, Cerebral cortex.

[21]  Wulfram Gerstner,et al.  Generalized integrate-and-fire models of neuronal activity approximate spike trains of a detailed model to a high degree of accuracy. , 2004, Journal of neurophysiology.

[22]  Sangmook Lee,et al.  Rapid, reversible impairment of synaptic signaling in cultured cortical neurons by exogenously-applied amyloid-β. , 2013, Journal of Alzheimer's disease : JAD.

[23]  Doheon Lee,et al.  Stochastic Simulation Model for Patterned Neural Multi-Electrode Arrays , 2007, 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering.

[24]  Romain Brette,et al.  Neuroinformatics Original Research Article Brian: a Simulator for Spiking Neural Networks in Python , 2022 .

[25]  Steve M. Potter,et al.  A new approach to neural cell culture for long-term studies , 2001, Journal of Neuroscience Methods.