Modelling a hormone-inspired controller for individual- and multi-modular robotic systems

For all living organisms, the ability to regulate internal homeostasis is a crucial feature. This ability to control variables around a set point is found frequently in the physiological networks of single cells and of higher organisms. Also, nutrient allocation and task selection in social insect colonies can be interpreted as homeostatic processes of a super-organism. And finally, behaviour can also represent such a control scheme. We show how a simple model of hormone regulation, inspired by simple biological organisms, can be used as a novel method to control the behaviour of autonomous robots. We demonstrate the formulation of such an artificial homeostatic hormone system (AHHS) by a set of linked difference equations and explain how the homeostatic control of behaviour is achieved by homeostatic control of the internal ‘hormonal’ state of the robot. The first task that we used to check the quality of our AHHS controllers was a very simple one, which is often a core functionality in controller programmes that are used in autonomous robots: obstacle avoidance. We demonstrate two implementations of such an AHHS controller that performs this task in differing levels of quality. Both controllers use the concept of homeostatic control of internal variables (hormones) and they extend this concept to also include the outside world of the robots into the controlling feedback loops: As they try to regulate internal hormone levels, they are forced to keep a homeostatic control of sensor values in a way that the desired goal ‘obstacle avoidance’ is achieved. Thus, the created behaviour is also a manifestation of the acts of homeostatic control. The controllers were evaluated using a stock-and-flow model that allowed sensitivity analysis and stability tests. Afterwards, we have also tested both controllers in a multi-agent simulation tool, which allowed us to predict the robots' behaviours in various habitats and group sizes. Finally, we demonstrate how this novel AHHS controller is suitable to control a multi-cellular robotic organism in an evolutionary robotics approach, which is used for self-programming in a gait-learning task. These examples shown in this article represent the first step in our research towards autonomous aggregation and coordination of robots to higher-level modular robotic organisms that consist of several joined autonomous robotic units. Finally, we plan to achieve such aggregation patterns and to control complex-shaped robotic organisms using AHHS controllers, as they are described here.

[1]  Francesco Mondada,et al.  The e-puck, a Robot Designed for Education in Engineering , 2009 .

[2]  Masud Mansuripur,et al.  Introduction to information theory , 1986 .

[3]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[4]  Phil Husbands,et al.  A multiple hormone approach to the homeostatic control of conflicting behaviours in an autonomous mobile robot , 2009, 2009 IEEE Congress on Evolutionary Computation.

[5]  Jon Timmis,et al.  Timidity: A Useful Mechanism for Robot Control? , 2003 .

[6]  John Hallam,et al.  Using evolutionary methods to parameterize neural models: a study of the lamprey central pattern generator , 2003 .

[7]  Wei-Min Shen,et al.  Hormone-Inspired Self-Organization and Distributed Control of Robotic Swarms , 2004, Auton. Robots.

[8]  Mark Stefik,et al.  V. Braitenberg, Vehicles: Experiments in Synthetic Psychology , 1985, Artificial Intelligence.

[9]  Ingo Rechenberg,et al.  Evolutionsstrategie '94 , 1994, Werkstatt Bionik und Evolutionstechnik.

[10]  S Erol Swarm Robotics: From Sources of Inspiration to Domains of Application , 2005 .

[11]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[12]  John N. Warfield,et al.  World dynamics , 1973 .

[13]  David W. Payton,et al.  Pheromone Robotics , 2001, Auton. Robots.

[14]  T. Schmickl,et al.  Individual adaptation allows collective path-finding in a robotic swarm , 2007 .

[15]  Fazlollah M. Reza,et al.  Introduction to Information Theory , 2004, Lecture Notes in Electrical Engineering.

[16]  Erol Sahin,et al.  Swarm Robotics: From Sources of Inspiration to Domains of Application , 2004, Swarm Robotics.

[17]  Paolo Dario,et al.  Optical Networking in a Swarm of Microrobots , 2008, NanoNet.

[18]  Dario Floreano,et al.  Neuroevolution: from architectures to learning , 2008, Evol. Intell..

[19]  T. Schmickl,et al.  Trophallaxis among swarm-robots: A biologically inspired strategy for swarm robotics , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[20]  Thomas Schmickl,et al.  Analysis and implementation of an Artificial Homeostatic Hormone System: A first case study in robotic hardware , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Gerardo Beni,et al.  From Swarm Intelligence to Swarm Robotics , 2004, Swarm Robotics.

[22]  Lola Cañamero,et al.  Hormonal Modulation of Perception in Motivation-Based Action Selection Architectures , 2005 .

[23]  Barbara Webb,et al.  Swarm Intelligence: From Natural to Artificial Systems , 2002, Connect. Sci..

[24]  Gregory J. Barlow,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Fitness Functions in Evolutionary Robotics: a Survey and Analysis , 2022 .

[25]  Paolo Dario,et al.  Micromanipulation, communication and swarm intelligence issues in a swarm microrobotic platform , 2006, Robotics Auton. Syst..

[26]  Thomas Schmickl,et al.  Evolving a Novel Bio-inspired Controller in Reconfigurable Robots , 2009, ECAL.

[27]  Wei-Min Shen,et al.  Hormone-inspired adaptive communication and distributed control for CONRO self-reconfigurable robots , 2002, IEEE Trans. Robotics Autom..

[28]  Thomas Schmickl,et al.  A hormone-based controller for evolutionary multi-modular robotics: From single modules to gait learning , 2010, IEEE Congress on Evolutionary Computation.

[29]  Phil Husbands,et al.  Homeostasis and evolution together dealing with novelties and managing disruptions , 2009, Int. J. Intell. Comput. Cybern..

[30]  Thomas Schmickl,et al.  Artificial Hormone Reaction Networks - Towards Higher Evolvability in Evolutionary Multi-Modular Robotics , 2010, ALIFE.

[31]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[32]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[33]  Heinz Wörn,et al.  Symbricator3D - A Distributed Simulation Environment for Modular Robots , 2009, ICIRA.

[34]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[35]  Phil Husbands,et al.  Evolutionary robotics , 2014, Evolutionary Intelligence.

[36]  Wei-Min Shen,et al.  Regenerative patterning in Swarm Robots: mutual benefits of research in robotics and stem cell biology. , 2009, The International journal of developmental biology.

[37]  Thomas Schmickl,et al.  Trophallaxis within a robotic swarm: bio-inspired communication among robots in a swarm , 2008, Auton. Robots.

[38]  Wei-Min Shen,et al.  Scalable self-assembly and self-repair in a collective of robots , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Schmickl Thomas,et al.  Bio-inspired Navigation of Autonomous Robots in Heterogenous Environments , .

[40]  J. Pierce An introduction to information theory: symbols, signals & noise , 1980 .

[41]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[42]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[43]  F. H. Adler Cybernetics, or Control and Communication in the Animal and the Machine. , 1949 .

[44]  Heinz Wörn,et al.  A Space- and Time-Continuous Model of Self-Organizing Robot Swarms for Design Support , 2007, First International Conference on Self-Adaptive and Self-Organizing Systems (SASO 2007).

[45]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[46]  Heinz Wörn,et al.  The I-SWARM Project: Intelligent Small World Autonomous Robots for Micro-manipulation , 2004, Swarm Robotics.

[47]  Wei-Min Shen,et al.  A scalable and distributed model for self-organization and self-healing , 2008, AAMAS.

[48]  Shigeki Sugano,et al.  Emotional Communication Robot: WAMOEBA-2R - Emotion Model and Evaluation Experiments - , 2000 .

[49]  Thomas Schmickl,et al.  Collective Perception in a Robot Swarm , 2006, Swarm Robotics.

[50]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[51]  Thomas Schmickl,et al.  A Navigation Algorithm for Swarm Robotics Inspired by Slime Mold Aggregation , 2006, Swarm Robotics.