Variants of guided self-organization for robot control

Autonomous robots can generate exploratory behavior by self-organization of the sensorimotor loop. We show that the behavioral manifold that is covered in this way can be modified in a goal-dependent way without reducing the self-induced activity of the robot. We present three strategies for guided self-organization, namely by using external rewards, a problem-specific error function, or assumptions about the symmetries of the desired behavior. The strategies are analyzed for two different robots in a physically realistic simulation.

[1]  Stefan Schaal,et al.  Natural Actor-Critic , 2003, Neurocomputing.

[2]  Mikhail Prokopenko,et al.  Advances in Applied Self-Organizing Systems , 2013, Advanced Information and Knowledge Processing.

[3]  Ralf B. Wehrspohn,et al.  Mechanism of guided self-organization producing quasi-monodomain porous alumina , 2005 .

[4]  Ralf Der,et al.  Homeokinetic approach to autonomous learning in mobile robots , 2002 .

[5]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[6]  J. Michael Herrmann.  Dynamical systems for predictive control of autonomous robots , 2001, Theory in Biosciences.

[7]  James A. Reggia,et al.  Guided self-organizing particle systems for basic problem solving , 2007 .

[8]  John Hallam,et al.  Evolving Swimming Controllers for a Simulated Lamprey with Inspiration from Neurobiology , 1999, Adapt. Behav..

[9]  Stefano Nolfi,et al.  Evolving morphology and control: A distributed approach , 2009, 2009 IEEE Congress on Evolutionary Computation.

[10]  G. Zajicek,et al.  The Wisdom of the Body , 1934, Nature.

[11]  Ralf Der,et al.  Self-organized acquisition of situated behaviors , 2001, Theory in Biosciences.

[12]  Mikhail Prokopenko,et al.  Design vs. Self-organization , 2008, Advances in Applied Self-organizing Systems.

[13]  Stefano Nolfi,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , 2000 .

[14]  A. Opstal.  Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .

[15]  E. D. Paolo,et al.  Organismically-inspired robotics : homeostatic adaptation and teleology beyond the closed sensorimotor loop , 2003 .

[16]  Yang Dongyong,et al.  Distal supervised learning control and its application to CSTR systems , 2000, SICE 2000. Proceedings of the 39th SICE Annual Conference. International Session Papers (IEEE Cat. No.00TH8545).

[17]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[18]  R. Der,et al.  True autonomy from self-organized adaptivity , 2002 .

[19]  M. Prokopenko.  Guided self‐organization , 2009, HFSP journal.

[20]  Ralf Der,et al.  Rocking Stamper and Jumping Snakes from a Dynamical Systems Approach to Artificial Life , 2006, Adapt. Behav..

[21]  Ralf Der.  Self-organized acquisition of situated behaviors , 2001 .

[22]  Yuan F. Zheng,et al.  Distal learning applied to biped robots , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[23]  Ralf Der,et al.  Guided Self-organisation for Autonomous Robot Development , 2007, ECAL.

[24]  E de Margerie,et al.  Artificial evolution of the morphology and kinematics in a flapping-wing mini-UAV , 2007, Bioinspiration & biomimetics.

[25]  Mikhail Prokopenko,et al.  Evolving Spatiotemporal Coordination in a Modular Robotic System , 2006, SAB.

[26]  J. Michael Herrmann,et al.  Tipping the scales: guidance and intrinsically motivated behavior , 2011, ECAL.

[27]  Richard S. Sutton,et al.  Reinforcement Learning: Past, Present and Future , 1998, SEAL.

[28]  Ben J. A. Kröse,et al.  Distributed adaptive control: The self-organization of structured behavior , 1992, Robotics Auton. Syst..

[29]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..