Evolving Communication in Embodied Agents: Theory, Methods, and Evaluation

In this chapter we introduce the area of research that attempts to study the evolution of communication in embodied agents through adaptive techniques, such us artificial evolution. More specifically, we illustrate the theoretical assumptions behind this type of research, we present the methods that can be used to realize embodied and communicating artificial agents, and we discuss the main research challenges and the criteria for evaluating progresses in this field.

[1]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[2]  R. Mizen.  The embodied mind. , 2009, The Journal of analytical psychology.

[3]  Stefano Nolfi,et al.  Power and the limits of reactive agents , 2002, Neurocomputing.

[4]  H. Papoušek,et al.  Nonverbal Vocal Communication: Comparative and Developmental Approaches , 2008 .

[5]  Angelo Cangelosi,et al.  The Emergence of a 'Language' in an Evolving Population of Neural Networks , 1998, Connect. Sci..

[6]  Tom Ziemke,et al.  Social Situatedness of Natural and Artificial Intelligence: Vygotsky and Beyond , 2003, Adapt. Behav..

[7]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[8]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[9]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[10]  A. Clark.  Being There: Putting Brain, Body, and World Together Again , 1996 .

[11]  F. Keijzer.  Representation and Behavior , 2001 .

[12]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[13]  Yasuo Kuniyoshi,et al.  Embedded neural networks: exploiting constraints , 1998, Neural Networks.

[14]  Stefano Nolfi,et al.  Emergence of communication in embodied agents: co-adapting communicative and non-communicative behaviours , 2005, Connect. Sci..

[15]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[16]  E. D. Paolo,et al.  Participatory sensemaking An enactive approach to social cognition , 2007 .

[17]  Jürgen Schmidhuber,et al.  Reinforcement Learning Soccer Teams with Incomplete World Models , 1999, Auton. Robots.

[18]  T. Sejnowski,et al.  A critique of pure vision , 1993 .

[19]  Lincoln Smith,et al.  Evolving controllers for a homogeneous system of physical robots: structured cooperation with minimal sensors , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[20]  Cliff Hooker.  Philosophy of complex systems , 2011 .

[21]  Stefano Nolfi,et al.  Emergence of communication in embodied agents evolved for the ability to solve a collective navigation problem , 2007, Connect. Sci..

[22]  Marco Dorigo,et al.  Self-organisation and communication in groups of simulated and physical robots , 2006, Biological Cybernetics.

[23]  Domenico Parisi,et al.  How Producer Biases Can Favor the Evolution of Communication: An Analysis of Evolutionary Dynamics , 2008, Adapt. Behav..

[24]  Charles E. Taylor,et al.  Artificial Life II , 1991 .

[25]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..

[26]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[27]  Simon Kirby,et al.  Natural Language From Artificial Life , 2002, Artificial Life.

[28]  W. J. Smith.  The behavior of communicating , 1977 .

[29]  Kenji Doya,et al.  Reinforcement Learning in Continuous Time and Space , 2000, Neural Computation.

[30]  Dario Floreano,et al.  Coevolution of active vision and feature selection , 2004, Biological Cybernetics.

[31]  Matthew Quinn,et al.  Evolving Communication without Dedicated Communication Channels , 2001, ECAL.

[32]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[33]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[34]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[35]  Kenneth Webb,et al.  Evolution of Communication Simulation of Adaptive Behavior – Project Report , 2004 .

[36]  G. Kane.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[37]  E. D. Paolo,et al.  Participatory sense-making , 2007 .

[38]  David H. Ackley,et al.  Altruism in the evolution of communication , 1994 .

[39]  M Oliphant,et al.  The dilemma of Saussurean communication. , 1996, Bio Systems.

[40]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[41]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[42]  Andy Clark,et al.  Towards a Cognitive Robotics , 1999, Adapt. Behav..

[43]  M. Hauser,et al.  Functional referents and acoustic similarity: field playback experiments with rhesus monkeys , 1998, Animal Behaviour.

[44]  D. Parisi,et al.  Towards a Vygotskyan cognitive robotics: The role of language as a cognitive tool , 2011 .

[45]  Sylvia Weir,et al.  Action perception , 1974 .

[46]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[47]  R. Morse.  The Dance Language and Orientation of Bees , 1994 .

[48]  E. Kako.  Elements of syntax in the systems of three language-trained animals , 1999 .

[49]  Stefano Nolfi,et al.  Behaviour as a Complex Adaptive System: On the Role of Self-Organization in the Development of Individual and Collective Behaviour , 2004, Complexus.

[50]  Phil Husbands,et al.  Evolutionary robotics , 2014, Evolutionary Intelligence.

[51]  P. Marler,et al.  Vervet monkey alarm calls: Semantic communication in a free-ranging primate , 1980, Animal Behaviour.

[52]  Stefano Nolfi,et al.  Behavior and Cognition as a Complex Adaptive System: Insights from Robotic Experiments , 2011 .

[53]  Stefan Schaal,et al.  2008 Special Issue: Reinforcement learning of motor skills with policy gradients , 2008 .

[54]  R. Paget.  The Origin of Speech , 1927, Nature.

[55]  Ezequiel A. Di Paolo,et al.  Social coordination and spatial organization: Steps towards the evolution of communication , 1997 .

[56]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[57]  Angelo Cangelosi,et al.  Evolution of communication and language using signals, symbols, and words , 2001, IEEE Trans. Evol. Comput..

[58]  D Cliff,et al.  Knowledge-based vision and simple visual machines. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[59]  Stefan Schaal,et al.  Learning to Control in Operational Space , 2008, Int. J. Robotics Res..

[60]  Jun Tani,et al.  Learning Semantic Combinatoriality from the Interaction between Linguistic and Behavioral Processes , 2005, Adapt. Behav..

[61]  Stefano Nolfi,et al.  Social learning and cultural evolution in embodied and situated agents , 2007, 2007 IEEE Symposium on Artificial Life.

[62]  Stefano Nolfi,et al.  Active perception: a sensorimotor account of object categorization , 2002 .

[63]  D. Rendall,et al.  The meaning and function of grunt variants in baboons , 1999, Animal Behaviour.

[64]  Stefano Nolfi,et al.  Econets: Neural networks that learn in an environment , 1990 .

[65]  James A. Reggia,et al.  Progress in the Simulation of Emergent Communication and Language , 2003, Adapt. Behav..

[66]  Thomas P. von Hoff,et al.  Adaptive step-size control in blind source separation , 2002, Neurocomputing.

[67]  G. M. Werner.  Evolution of Communication in Artificial Organisms, Artifial Life II , 1991 .