Reflex-oscillations in evolved single leg neurocontrollers for walking machines

As a prerequisite for developing neural control for walking machines that are able to autonomously navigate through rough terrain, artificial structure evolution is used to generate various single leg controllers. The structure and dynamical properties of the evolved (recurrent) neural networks are then analysed to identify elementary mechanisms of sensor-driven walking behaviour. Based on the biological understanding that legged locomotion implies a highly decentralised and modular control, neuromodules for single, morphological distinct legs of a hexapod walking machine were developed by using a physical simulation. Each of the legs has three degrees of freedom (DOF). The presented results demonstrate how extremely small reflex-oscillators, which inherently rely on the sensorimotor loop and e.g. hysteresis effects, generate effective locomotion. Varying the fitness function by randomly changing the environmental conditions during evolution, neural control mechanisms are identified which allow for robust and adaptive locomotion. Relations to biological findings are discussed.

[1]  Cynthia Ferrell,et al.  A comparison of three insect-inspired locomotion controllers , 1995, Robotics Auton. Syst..

[2]  F. Dudek,et al.  Persistent calcium current in rat suprachiasmatic nucleus neurons , 2006, Neuroscience.

[3]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[4]  A. Prochazka,et al.  Implications of positive feedback in the control of movement. , 1997, Journal of neurophysiology.

[5]  K. Pearson,et al.  Characteristics of Leg Movements and Patterns of Coordination in Locusts Walking on Rough Terrain , 1984 .

[6]  H. Cruse What mechanisms coordinate leg movement in walking arthropods? , 1990, Trends in Neurosciences.

[7]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[8]  R J Full,et al.  How animals move: an integrative view. , 2000, Science.

[9]  Simon Parsons,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines by Stefano Nolfi and Dario Floreano, MIT Press, 320 pp., $28.00, ISBN 0-262-14070-5 , 2004, Knowledge engineering review (Print).

[10]  Sasha N. Zill,et al.  Evolutionary adaptation of a reflex system: sensory hysteresis counters muscle ‘catch’ tension , 1988, Journal of Comparative Physiology A.

[11]  Chrystopher L. Nehaniv,et al.  Legs that can walk: embodiment-based modular reinforcement learning applied , 2005, 2005 International Symposium on Computational Intelligence in Robotics and Automation.

[12]  Rodney A. Brooks,et al.  A robot that walks; emergent behaviors from a carefully evolved network , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[13]  Christian R. Linder,et al.  Embodiment in Two Dimensions , 2005 .

[14]  Frank Pasemann,et al.  SO(2)-Networks as Neural Oscillators , 2003, IWANN.

[15]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[16]  C. Heckman,et al.  Bistability in spinal motoneurons in vivo: systematic variations in persistent inward currents. , 1998, Journal of neurophysiology.

[17]  E. Marder,et al.  The behavioral repertoire of the gastric mill in the crab, Cancer pagurus: an in situ endoscopic and electrophysiological examination , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  V. Crunelli,et al.  Analysis and biophysical interpretation of bistable behaviour in thalamocortical neurons , 1998, Neuroscience.

[19]  Daniel A. Kingsley,et al.  Parallel Complementary Strategies for Implementing Biological Principles into Mobile Robots , 2003, Int. J. Robotics Res..

[20]  A. Büschges,et al.  Dynamic simulation of insect walking. , 2004, Arthropod structure & development.

[21]  A. Büschges Sensory control and organization of neural networks mediating coordination of multisegmental organs for locomotion. , 2005, Journal of neurophysiology.

[22]  F. Pasemann Complex dynamics and the structure of small neural networks , 2002, Network.

[23]  Thomas Kindermann,et al.  Control of Walking in the Stick Insect: From Behavior and Physiology to Modeling , 1999, Auton. Robots.

[24]  Randall D. Beer,et al.  Connection and Coordination: The Interplay Between Architecture and Dynamics in Evolved Model Pattern Generators , 2006, Neural Computation.

[25]  J. Schmitz,et al.  Rhythmic patterns in the thoracic nerve cord of the stick insect induced by pilocarpine , 1995, The Journal of experimental biology.

[26]  G. Laurent,et al.  Hysteresis reduction in proprioception using presynaptic shunting inhibition. , 1995, Journal of neurophysiology.

[27]  F. Pasemann DYNAMICS OF A SINGLE MODEL NEURON , 1993 .

[28]  S. Grillner,et al.  Intrinsic function of a neuronal network — a vertebrate central pattern generator 1 Published on the World Wide Web on 8 April 1998. 1 , 1998, Brain Research Reviews.

[29]  Holk Cruse,et al.  The functional sense of central oscillations in walking , 2002, Biological Cybernetics.

[30]  A. I. Kostyukov,et al.  Muscle hysteresis and movement control: A theoretical study , 1998, Neuroscience.

[31]  R. Robertson,et al.  Neuronal Circuits: An Evolutionary Perspective , 1986, Science.

[32]  H. Cruse,et al.  Movement of Joint Angles in the Legs of a Walking Insect, Carausius morosus , 1995 .

[33]  S. Grillner,et al.  Neuronal Control of LocomotionFrom Mollusc to Man , 1999 .

[34]  G. Wendler The co-ordination of walking movements in arthropods. , 1966, Symposia of the Society for Experimental Biology.

[35]  H. Cruse,et al.  A Biologically Inspired Controller for Hexapod Walking: Simple Solutions by Exploiting Physical Properties , 2001, The Biological Bulletin.

[36]  Randall D. Beer,et al.  Evolving Dynamical Neural Networks for Adaptive Behavior , 1992, Adapt. Behav..

[37]  U. Bässler,et al.  Pattern generation for stick insect walking movements—multisensory control of a locomotor program , 1998, Brain Research Reviews.

[38]  Fred Delcomyn,et al.  Walking Robots and the Central and Peripheral Control of Locomotion in Insects , 1999, Auton. Robots.

[39]  R. Full,et al.  Dynamic stabilization of rapid hexapedal locomotion. , 2002, The Journal of experimental biology.

[40]  J. Dean Animats and what they can tell us , 1998, Trends in Cognitive Sciences.

[41]  Frank Pasemann,et al.  Structure and function of evolved neuro-controllers for autonomous robots , 2004, Connect. Sci..