On the evolution of self-organising behaviours in a swarm of autonomous robots

The goal of the research activities presented in this thesis is the design of intelligent behaviours for a complex robotic system, which is composed of a swarm of autonomous units. Inspired by the organisational skills of social insects, we are particularly interested in the study of collective behaviours based on self-organisation.The problem of designing self-organising behaviours for a swarm of robots is tackled resorting to artificial evolution, which proceeds in a bottom-up direction by first defining the controllers at the individual level and then testing their effect at the collective level. In this way, it is possible to bypass the difficulties encountered in the decomposition of the global behaviour into individual ones, and the further encoding of the individual behaviours into the controllers' rules. In the experiments presented in this thesis, we show that this approach is viable, as it produces efficient individual controllers and robust self-organising behaviours. To the best of our knowledge, our experiments are the only example of evolved self-organising behaviours that are successfully tested on a physical robotic platform.Besides the engineering value, the evolution of self-organising behaviours for a swarm of robots also provides a mean for the understanding of those biological processes that were a fundamental source of inspiration in the first place. In this perspective, the experiments presented in this thesis can be considered an interesting instance of a synthetic approach to the study of collective intelligence and, more in general, of Cognitive Science.

[1]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[2]  Marco Dorigo,et al.  Self-Organized Coordinated Motion in Groups of Physically Connected Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Marco Dorigo,et al.  Autonomous Self-Assembly in Swarm-Bots , 2006, IEEE Transactions on Robotics.

[4]  Marco Dorigo,et al.  Division of labor in a group of robots inspired by ants' foraging behavior , 2006, TAAS.

[5]  Marco Dorigo,et al.  Self-organisation and communication in groups of simulated and physical robots , 2006, Biological Cybernetics.

[6]  Stefano Nolfi,et al.  Distributed Coordination of Simulated Robots Based on Self-Organization , 2006, Artificial Life.

[7]  Marco Dorigo,et al.  Object transport by modular robots that self-assemble , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[8]  Marco Dorigo,et al.  Transport of an object by six pre-attached robots interacting via physical links , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[9]  Marco Dorigo,et al.  Cooperative hole avoidance in a swarm-bot , 2006, Robotics Auton. Syst..

[10]  Eric Klavins,et al.  Programmable parts: a demonstration of the grammatical approach to self-organization , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Raimon Casanova,et al.  Towards co-operative autonomous 1cm/sup 3/ robots for micro and nanomanipulation applications: MICRON , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Saul Griffith,et al.  Robotics: Self-replication from random parts , 2005, Nature.

[13]  Marco Dorigo,et al.  Evolving Neural Mechanisms for an Iterated Discrimination Task: A Robot Based Model , 2005, ECAL.

[14]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[15]  H. Kurokawa,et al.  Automatic locomotion design and experiments for a Modular robotic system , 2005, IEEE/ASME Transactions on Mechatronics.

[16]  Alan F. T. Winfield,et al.  Mascarillons: flying swarm intelligence for architectural research , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[17]  John Woods,et al.  Beyond swarm intelligence: the UltraSwarm , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[18]  Marco Dorigo,et al.  Emergent collective decisions in a swarm of robots , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[19]  William M. Spears,et al.  Swarms for chemical plume tracing , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[20]  G. Bekey Autonomous Robots: From Biological Inspiration to Implementation and Control (Intelligent Robotics and Autonomous Agents) , 2005 .

[21]  Hod Lipson,et al.  Robotics: Self-reproducing machines , 2005, Nature.

[22]  Urban Simu,et al.  MICRON: Small Autonomous Robot for Cell Manipulation Applications , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[23]  Stefano Nolfi,et al.  Toward open-ended evolutionary robotics: evolving elementary robotic units able to self-assemble and self-reproduce , 2004, Connect. Sci..

[24]  Marco Dorigo,et al.  Group Transport of an Object to a Target That Only Some Group Members May Sense , 2004, PPSN.

[25]  Marco Dorigo,et al.  Evolution of Direct Communication for a Swarm-bot Performing Hole Avoidance , 2004, ANTS Workshop.

[26]  Marco Dorigo,et al.  Swarm Robotics: Special Issue Editorial , 2004 .

[27]  William M. Spears,et al.  Distributed, Physics-Based Control of Swarms of Vehicles , 2004 .

[28]  M. Dorigo,et al.  Evolving Self-Organizing Behaviors for a Swarm-Bot , 2004, Auton. Robots.

[29]  Luca Maria Gambardella,et al.  The SWARM-BOTS Project , 2004, Künstliche Intell..

[30]  Heinz Wörn,et al.  The I-SWARM Project: Intelligent Small World Autonomous Robots for Micro-manipulation , 2004, Swarm Robotics.

[31]  Xin Yang,et al.  A decentralized control system for cooperative transportation by multiple non-holonomic mobile robots , 2004 .

[32]  Thomas C. Henderson,et al.  Evolution of neural controllers for competitive game playing with teams of mobile robots , 2004, Robotics Auton. Syst..

[33]  Christopher M. Clark,et al.  Motion planning for formations of mobile robots , 2004, Robotics Auton. Syst..

[34]  Ying Zhang,et al.  Phase automata: a programming model of locomotion gaits for scalable chain-type modular robots , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[35]  O. Holland Exploration and high adventure: the legacy of Grey Walter , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[36]  Lincoln Smith,et al.  Evolving controllers for a homogeneous system of physical robots: structured cooperation with minimal sensors , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[37]  Marco Dorigo,et al.  Evolving Aggregation Behaviors in a Swarm of Robots , 2003, ECAL.

[38]  Eiji Nakano,et al.  Solving function distribution and behavior design problem for cooperative object handling by multiple mobile robots , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[39]  Paul S. Schenker,et al.  CAMPOUT: a control architecture for tightly coupled coordination of multirobot systems for planetary surface exploration , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[40]  Stefano Nolfi,et al.  Evolution of Collective Behavior in a Team of Physically Linked Robots , 2003, EvoWorkshops.

[41]  Dario Floreano,et al.  Exploring the T-Maze: Evolving Learning-Like Robot Behaviors Using CTRNNs , 2003, EvoWorkshops.

[42]  Maja J. Mataric,et al.  A general algorithm for robot formations using local sensing and minimal communication , 2002, IEEE Trans. Robotics Autom..

[43]  Lynne E. Parker,et al.  Guest editorial advances in multirobot systems , 2002, IEEE Trans. Robotics Autom..

[44]  Pradeep K. Khosla,et al.  Millibot trains for enhanced mobility , 2002 .

[45]  Wei-Min Shen,et al.  Using role-based control to produce locomotion in chain-type self-reconfigurable robots , 2002 .

[46]  Rodney M. Goodman,et al.  Distributed odor source localization , 2002 .

[47]  Stefano Nolfi,et al.  Evolving robots able to self-localize in the environment: the importance of viewing cognition as the result of processes occurring at different time-scales , 2002 .

[48]  Thomas Sugar,et al.  Control of cooperating mobile manipulators , 2002, IEEE Trans. Robotics Autom..

[49]  Alcherio Martinoli,et al.  Efficiency and robustness of threshold-based distributed allocation algorithms in multi-agent systems , 2002, AAMAS '02.

[50]  Tom Ziemke,et al.  Neuromodulation of Reactive Sensorimotor Mappings as a Short-Term Memory Mechanism in Delayed Response Tasks , 2002, Adapt. Behav..

[51]  Vijay Kumar,et al.  Modeling and control of formations of nonholonomic mobile robots , 2001, IEEE Trans. Robotics Autom..

[52]  Matthew Quinn,et al.  Evolving Communication without Dedicated Communication Channels , 2001, ECAL.

[53]  Luca Maria Gambardella,et al.  Collaboration Through the Exploitation of Local Interactions in Autonomous Collective Robotics: The Stick Pulling Experiment , 2001, Auton. Robots.

[54]  Matt Quinn,et al.  A comparison of approaches to the evolution of homogeneous multi-robot teams , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[55]  Guy Theraulaz,et al.  Self-Organization in Biological Systems , 2001, Princeton studies in complexity.

[56]  Shigeo Hirose,et al.  Study of Super-Mechano Colony: concept and basic experimental set-up , 2001, Adv. Robotics.

[57]  Shigeo Hirose,et al.  Super Mechano-System: New Perspective for Versatile Robotic System , 2000, ISER.

[58]  D. Floreano,et al.  Evolutionary Robotics: The Biology,Intelligence,and Technology , 2000 .

[59]  Laurent Keller,et al.  Ant-like task allocation and recruitment in cooperative robots , 2000, Nature.

[60]  Wei-Min Shen,et al.  CONRO: Towards Deployable Robots with Inter-Robots Metamorphic Capabilities , 2000, Auton. Robots.

[61]  Michael J. B. Krieger,et al.  The call of duty: Self-organised task allocation in a population of up to twelve mobile robots , 2000, Robotics Auton. Syst..

[62]  Eric Bonabeau,et al.  Cooperative transport by ants and robots , 2000, Robotics Auton. Syst..

[63]  Eiichi Yoshida,et al.  Self-assembly and self-repair method for a distributed mechanical system , 1999, IEEE Trans. Robotics Autom..

[64]  Francesco Mondada,et al.  Understanding collective aggregation mechanisms: From probabilistic modelling to experiments with real robots , 1999, Robotics Auton. Syst..

[65]  Seiji Yamada,et al.  Adaptive action selection without explicit communication for multi-robot box-pushing , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[66]  Jordan B. Pollack,et al.  Embodied evolution: embodying an evolutionary algorithm in a population of robots , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[67]  Wen-Hong Zhu,et al.  Control of two industrial manipulators rigidly holding an egg , 1999 .

[68]  Chris Melhuish,et al.  Stigmergy, Self-Organization, and Sorting in Collective Robotics , 1999, Artificial Life.

[69]  Tom Ziemke,et al.  Life, Mind, and Robots: The Ins and Outs of Embodied Cognition , 1998, Hybrid Neural Systems.

[70]  Tucker R. Balch,et al.  Behavior-based formation control for multirobot teams , 1998, IEEE Trans. Robotics Autom..

[71]  Lynne E. Parker,et al.  Adaptive heterogeneous multi-robot teams , 1998, Neurocomputing.

[72]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[73]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[74]  Eiichi Yoshida,et al.  Distributed formation control for a modular mechanical system , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[75]  Nick Jakobi,et al.  Evolutionary Robotics and the Radical Envelope-of-Noise Hypothesis , 1997, Adapt. Behav..

[76]  Gregory S. Chirikjian,et al.  Useful metrics for modular robot motion planning , 1997, IEEE Trans. Robotics Autom..

[77]  Maja J. Mataric,et al.  Using communication to reduce locality in distributed multiagent learning , 1997, J. Exp. Theor. Artif. Intell..

[78]  Maja J. Mataric,et al.  Learning social behavior , 1997, Robotics Auton. Syst..

[79]  Ronald C. Arkin,et al.  Robot Colonies , 1997, Springer US.

[80]  J. Deneubourg,et al.  Scavenging by Pheidole pallidula a key for understanding decision-making systems in ants , 1997, Animal Behaviour.

[81]  C. Ronald Kube,et al.  Task Modelling in Collective Robotics , 1997, Auton. Robots.

[82]  Oussama Khatib,et al.  Coordination and decentralized cooperation of multiple mobile manipulators , 1996, J. Field Robotics.

[83]  Dave Cliff,et al.  Challenges in evolving controllers for physical robots , 1996, Robotics Auton. Syst..

[84]  T. Seeley The Wisdom of the Hive , 1995 .

[85]  Martin Nilsson,et al.  Cooperative multi-robot box-pushing , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[86]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[87]  Bruce Randall Donald,et al.  Moving furniture with teams of autonomous robots , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[88]  T. D. Fitzgerald The Tent Caterpillars , 1995 .

[89]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[90]  Tucker R. Balch,et al.  Communication in reactive multiagent robotic systems , 1995, Auton. Robots.

[91]  Shigeo Hirose,et al.  A proposal for cooperative robot "Gunryu" composed of autonomous segments , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[92]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex adaptive systems.

[93]  Toshio Fukuda,et al.  Cellular Robotics and Micro Robotic Systems , 1994, World Scientific Series in Robotics and Intelligent Systems.

[94]  Maja J. Mataric,et al.  Reward Functions for Accelerated Learning , 1994, ICML.

[95]  J. Deneubourg,et al.  Modulation of trail laying in the antLasius niger (Hymenoptera: Formicidae) and its role in the collective selection of a food source , 1993, Journal of Insect Behavior.

[96]  Francesco Mondada,et al.  Mobile Robot Miniaturisation: A Tool for Investigation in Control Algorithms , 1993, ISER.

[97]  John von Neumann,et al.  First draft of a report on the EDVAC , 1993, IEEE Annals of the History of Computing.

[98]  Hong Zhang,et al.  Collective Robotics: From Social Insects to Robots , 1993, Adapt. Behav..

[99]  Inman Harvey,et al.  Issues in evolutionary robotics , 1993 .

[100]  Craig W. Reynolds An evolved, vision-based behavioral model of coordinated group motion , 1993 .

[101]  E. Rosch,et al.  The Embodied Mind: Cognitive Science and Human Experience , 1993 .

[102]  N. Franks,et al.  Brood sorting by ants: distributing the workload over the work-surface , 1992, Behavioral Ecology and Sociobiology.

[103]  Rodney A. Brooks,et al.  Intelligence Without Reason , 1991, IJCAI.

[104]  T. Seeley,et al.  Collective decision-making in honey bees: how colonies choose among nectar sources , 1991, Behavioral Ecology and Sociobiology.

[105]  Jean-Louis Deneubourg,et al.  The dynamics of collective sorting robot-like ants and ant-like robots , 1991 .

[106]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[107]  C. Detrain Field study on foraging by the polymorphic ant species,Pheidole pallidula , 1990, Insectes Sociaux.

[108]  J. Deneubourg,et al.  The self-organizing exploratory pattern of the argentine ant , 1990, Journal of Insect Behavior.

[109]  J. Deneubourg,et al.  Self-organized shortcuts in the Argentine ant , 1989, Naturwissenschaften.

[110]  J. Deneubourg,et al.  Collective patterns and decision-making , 1989 .

[111]  Paul Keng-Chieh Wang,et al.  Navigation Strategies For Multiple Autonomous Mobile Robots Moving In Formation , 1989, Proceedings. IEEE/RSJ International Workshop on Intelligent Robots and Systems '. (IROS '89) 'The Autonomous Mobile Robots and Its Applications.

[112]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[113]  E. Wilson,et al.  Dense heterarchies and mass communication as the basis of organization in ant colonies. , 1988, Trends in ecology & evolution.

[114]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[115]  G. Robinson Modulation of alarm pheromone perception in the honey bee: evidence for division of labor based on hormonall regulated response thresholds , 1987, Journal of Comparative Physiology A.

[116]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[117]  N. Franks Teams in social insects: group retrieval of prey by army ants (Eciton burchelli, Hymenoptera: Formicidae) , 1986, Behavioral Ecology and Sociobiology.

[118]  E. Wilson The relation between caste ratios and division of labor in the ant genus Pheidole (Hymenoptera: Formicidae) , 1984, Behavioral Ecology and Sociobiology.

[119]  J. Schwartz,et al.  On the “piano movers” problem. II. General techniques for computing topological properties of real algebraic manifolds , 1983 .

[120]  J. Schwartz,et al.  On the Piano Movers' Problem: III. Coordinating the Motion of Several Independent Bodies: The Special Case of Circular Bodies Moving Amidst Polygonal Barriers , 1983 .

[121]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[122]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[123]  H. Maturana,et al.  Autopoiesis: the organization of living systems, its characterization and a model. , 1974, Currents in modern biology.

[124]  W. Walter The Living Brain , 1963 .

[125]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[126]  W. Ashby,et al.  An introduction to cybernetics. , 1956 .

[127]  Allen Newell,et al.  The logic theory machine-A complex information processing system , 1956, IRE Trans. Inf. Theory.

[128]  W. Ashby,et al.  Design for a Brain. , 1953 .

[129]  W. Walter A Machine that Learns , 1951 .

[130]  W. Walter An Imitation of Life , 1950 .

[131]  Jacques Loeb,et al.  Forced Movements, Tropisms, And Animal Conduct , 1919 .

[132]  Marco Dorigo,et al.  Group Transport Along a Robot Chain in a Self-Organised Robot Colony , 2006, IAS.

[133]  Marco Dorigo,et al.  Evolving Communicating Agents that Integrate Information over Time: a Real Robot Experiment , 2005 .

[134]  Inman Harvey,et al.  Evolutionary Robotics: A New Scientific Tool for Studying Cognition , 2005, Artificial Life.

[135]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[136]  Francesco Mondada,et al.  Self-assembly on Demand in a Group of Physical Autonomous Mobile Robots Navigating Rough Terrain , 2005, ECAL.

[137]  Marco Dorigo,et al.  Cooperation through self-assembling in multi-robot systems , 2005 .

[138]  Nikolaus Correll,et al.  Collective Inspection of Regular Structures using a Swarm of Miniature Robots , 2004, ISER.

[139]  Maria Gini,et al.  Communication Strategies in Multi-robot Search and Retrieval: Experiences with MinDART , 2004, DARS.

[140]  Aude Billard,et al.  Evolving Functional Self-Assembling in a Swarm of Autonomous Robots , 2004 .

[141]  Aude Billard,et al.  From Animals to Animats , 2004 .

[142]  Elio Tuci,et al.  An exploration on the evolution of learning behaviour using robot-based models , 2004 .

[143]  Michael Jenkin,et al.  A Taxonomy of Multirobot Systems , 2003 .

[144]  H. Von Foerster,et al.  On Self-Organizing Systems and Their Environments , 2003 .

[145]  Roland Siegwart,et al.  Fascination of down scaling — Alice the sugar cube robot , 2001 .

[146]  Ezequiel A. Di Paolo,et al.  Behavioral Coordination, Structural Congruence and Entrainment in a Simulation of Acoustically Coupled Agents , 2000, Adapt. Behav..

[147]  Jean-Louis Deneubourg,et al.  From local actions to global tasks: stigmergy and collective robotics , 2000 .

[148]  Rodney M. Goodman,et al.  Comparing Distributed Exploration Strategies with Simulated and Autonomous Robots , 2000, DARS.

[149]  N. Stephenson The Diamond Age , 1995 .

[150]  Stefano Nolfi,et al.  Evolving Mobile Robots in Simulated and Real Environments , 1995, Artificial Life.

[151]  Randall D. Beer,et al.  A Dynamical Systems Perspective on Agent-Environment Interaction , 1995, Artif. Intell..

[152]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[153]  Daniel C. Dennett,et al.  Cognitive Wheels: The Frame Problem of AI , 1990, The Philosophy of Artificial Intelligence.

[154]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[155]  J. Deneubourg,et al.  Self-organization mechanisms in ant societies. II: Learning in foraging and division of labor , 1987 .

[156]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[157]  J. T. Shwartz,et al.  On the Piano Movers' Problem : III , 1983 .

[158]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[159]  Grégoire Nicolis,et al.  Self-Organization in nonequilibrium systems , 1977 .

[160]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[161]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[162]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[163]  Luca Maria Gambardella,et al.  c ○ 2004 Kluwer Academic Publishers. Manufactured in The Netherlands. Swarm-Bot: A New Distributed Robotic Concept , 2022 .