From lampreys to salamanders: evolving neural controllers for swimming and walking

FromlampreystosalamandersevolvingneuralcontrollersforswimmingandwalkingAukeJanIjsp eertJohnHallamDavidWillshawDeptof Articial Intelligence U ofEdinburghForrest Hill EdinburghEHQ UKfaukei johngdaiedacukCentreforCognitive ScienceUof EdinburghBuccleuchPlace EdinburghEHLWUKdavidcnsedacukAbstractThis pap er presents how neural swimming controllersfor a lamprey can b e adapted for controlling b oth theswimmingandthewalkingofasalamanderlikeanimatUsingaGeneticAlgorithmGAweextendaconnectionistmo delofthebiologicalCentralPattern Generator CPG controlling the swimming of alamprey Ekeb erg to control the lo comotion ofa D mechanical simulation of a salamanderWerstsummarizeexp erimentsontheevolutionofalternativeswimmingcontrollersforthelampreyIjsp eertet alTheaimofthatworkastostudy whether there exists other neural congurationsthanthatfoundin thelampreywhichcouldcontrolswimmingwiththesamee ciencyandtodevelopametho dfordevelopingneurallo comotioncontrollers using a GA We then presenthow that metho dnamelyastagedevolutionoftheneuralconguration of a connectionist mo del can b e used to extendswimming controllerstocontrol b oth swimming andwalking Controllers which similarly to CPGs of animals canpro duce complex oscillationswhen receivingsimple excitatory signals are thus develop ed In particular we generate a controller which can switch fromswimming to walking and pro duce dierent sp eeds ofmotion dep ending on its excitationIntro ductionAlthoughthereexistsavarietyofdierentlo comotormovements among vertebrates their control systems appearrelativelysimilaracrossdierentsp ecies Grillneret al Lo comotion is controlled by networks of interneurons lo cated in the spinal cord which pro duce thecomplex patterns of oscillations necessary for motion Asdemonstrated in the s byOrlovsky s classical exp eriment on the cat as rep orted in Grillner thesenetworks called Central Pattern Generators needonlysimple excitatory signals from the brain to pro duce theco ordinated oscillations necessary for motionOur research fo cusses on biologically inspired neurallo comotion controllers for autonomous agents and howtodevelop them using a GeneticAlgorithm GA In particular we are interested in which kinds of neural conguration can control the anguiliform swimming observedin lampreys and the swimming and walking of salamanders Both lampreys and salamanders pro ject themselvesin water by undulation of the b o dy without use of nsor limbs The undulation is a traveling wae propagatingfromheadtotailWhenthesalamander switchesswimmingtowalking itstrunkceases topropagate anundulation and instead p erforms an S shap ed standingwave with theno des atthe level ofthe girdles Frolichand Biewener The b ending of the trunk helps thesalamander to increase thereach of its limbs which areattached laterally to the trunkThe work presented here follows exp eriments in whichwe used a GAtoevolve swimming controllers for a simulatedlampreywithalternativeneuralcongurationstotheobservedbiological conguration Ijsp eertet al The work was inspired by a biological connectionistmo delofthelamprey sCPGEkeb erg Wedevelop ed articial controllers using an incremental approach whereincreasingly complexcontrol mechanismsare develop ed using elements of theprevious evolutionarystageHereasthemetho dprovedtobeausefuldesigntechniqueweapplyitagaintostudywhethercontrollersforswimmingcanbeextendedtotrolb oth swimming and walking of a salamanderlike animatWalking controllers based on oscillatory networks of theswimming controllers are generated for the control of adimensional mechanical simulation of the salamanderWeare interested in the development of control mechanismswhichsimilarlytotheCPGsofanimalscanpro ducecomplexoscillationswhenreceivingsimpleinputsignals Ap otentialapplication ofthese controllerscould b e the control of lo comotion of an amphibian rob ot Another motivation is to gain some insights on howCPGs function in real animals Note that the evolutionfrom swimming to walking controllers and its applicationto rob otics has b een studied b efore Lewis but at

[1]  S. Grillner,et al.  Newly identified 'glutamate interneurons' and their role in locomotion in the lamprey spinal cord. , 1987, Science.

[2]  S. Rossignol,et al.  Neural Control of Rhythmic Movements in Vertebrates , 1988 .

[3]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[4]  J. Buchanan Neural Control of Locomotion in Lower Vertebrates: From Behavior to Ionic Mechanisms , 1988 .

[5]  S. Grillner,et al.  Synaptic effects of intraspinal stretch receptor neurons mediating movement-related feedback during locomotion , 1990, Brain Research.

[6]  S. Grillner,et al.  A computer based model for realistic simulations of neural networks. I. The single neuron and synaptic interaction. , 1991, Biological cybernetics.

[7]  S. Grillner,et al.  Neuronal network generating locomotor behavior in lamprey: circuitry, transmitters, membrane properties, and simulation. , 1991, Annual review of neuroscience.

[8]  T. Williams Phase coupling by synaptic spread in chains of coupled neuronal oscillators. , 1992, Science.

[9]  L. M. Frolich,et al.  KINEMATIC AND ELECTROMYOGRAPHIC ANALYSIS OF THE FUNCTIONAL ROLE OF THE BODY AXIS DURING TERRESTRIAL AND AQUATIC LOCOMOTION IN THE SALAMANDER AMBYSTOMA TIGRINUM , 1992 .

[10]  S. Grillner,et al.  Neural mechanisms of intersegmental coordination in lamprey: local excitability changes modify the phase coupling along the spinal cord. , 1992, Journal of neurophysiology.

[11]  S. Grillner,et al.  A computer-based model for realistic simulations of neural networks. II. The segmental network generating locomotor rhythmicity in the lamprey. , 1992 .

[12]  Örjan Ekeberg,et al.  The Neural Control of Fish Swimming Studied Through Numerical Simulations , 1995, Adapt. Behav..

[13]  M. A. Lewis,et al.  Self-organization of locomotory controllers in robots and animals , 1996 .

[14]  S. Grillner Neural networks for vertebrate locomotion. , 1996, Scientific American.

[15]  J. Cabelguen,et al.  Epaxial and limb muscle activity during swimming and terrestrial stepping in the adult newt, Pleurodeles waltl. , 1997, Journal of neurophysiology.

[16]  Anders Lansner,et al.  Intersegmental coordination in the lamprey: simulations using a network model without segmental boundaries , 1997, Biological Cybernetics.

[17]  John Hallam,et al.  Evolving Swimming Controllers for a Simulated Lamprey with Inspiration from Neurobiology , 1999, Adapt. Behav..