Emergence of communication in embodied agents: co-adapting communicative and non-communicative behaviours

In this paper, I discuss in which conditions a population of embodied and situated agents that have to solve problems that require co-operation might develop forms of ritualized interaction and communication. After reviewing the most relevant literature, I shall try to identify the main open research problems and the most promising research directions. More specifically, I shall discuss: (a) the type of problems, the agents’ characteristics and the environmental/social conditions that might facilitate the emergence of an ability to interact and communicate; and (b) the behavioural and cognitive capabilities that are crucial for the development of forms of communication of different complexity.

[1]  Stefano Nolfi,et al.  Emergence of communication in embodied agents evolved for the ability to solve a collective navigation problem , 2007, Connect. Sci..

[2]  Randall D. Beer,et al.  The Dynamics of Active Categorical Perception in an Evolved Model Agent , 2003, Adapt. Behav..

[3]  R. Pfeifer,et al.  Evolving Complete Agents using Artificial Ontogeny , 2003 .

[4]  Hiroyuki Iizuka,et al.  Adaptive Coupling and Intersubjectivity in Simulated Turn-Taking Behaviour , 2003, ECAL.

[5]  Yasuo Kuniyoshi,et al.  Embedded neural networks: exploiting constraints , 1998, Neural Networks.

[6]  Dario Floreano,et al.  Evolution of Plastic Control Networks , 2001, Auton. Robots.

[7]  David G. Stork,et al.  Evolution and Learning in Neural Networks , 1990, NIPS.

[8]  Phil Husbands,et al.  Language, Altruism and Docility: How Cultural Learning Can Favour Language Evolution , 2004 .

[9]  Bruce J. MacLennan,et al.  Synthetic Ethology and the Evolution of Cooperative Communication , 1993, Adapt. Behav..

[10]  Stefano Nolfi,et al.  The emergence of communication in evolutionary robots , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[11]  Stefan Schaal,et al.  A Connectionist Approach to Learn Association between Sentences and Behavioral Patterns of a Robot , 2004 .

[12]  Hiroyuki Iizuka,et al.  Simulating turn-taking behaviours with coupled dynamical recognizers , 2002 .

[13]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[14]  Jun Tani,et al.  Self-organization of distributedly represented multiple behavior schemata in a mirror system: reviews of robot experiments using RNNPB , 2004, Neural Networks.

[15]  Stefano Nolfi,et al.  Learning to Adapt to Changing Environments in Evolving Neural Networks , 1996, Adapt. Behav..

[16]  Luc Steels,et al.  Aibo''s first words. the social learning of language and meaning. Evolution of Communication , 2002 .

[17]  Angelo Cangelosi,et al.  Simulating the Evolution of Language , 2002, Springer London.

[18]  Stefano Nolfi,et al.  Extracting Regularities in Space and Time Through a Cascade of Prediction Networks: The Case of a Mobile Robot Navigating in a Structured Environment , 1999, Connect. Sci..

[19]  A. Cangelosi,et al.  How Nouns and Verbs Differentially Affect the Behavior of Artificial Organisms , 2001 .

[20]  Stefano Nolfi,et al.  Power and the limits of reactive agents , 2002, Neurocomputing.

[21]  Andy Clark,et al.  Towards a Cognitive Robotics , 1999, Adapt. Behav..

[22]  Seth Bullock,et al.  Adaptive factors in the evolution of signaling systems , 2002 .

[23]  Inman Harvey,et al.  Seeing the Light: Artiicial Evolution, Real Vision Seeing the Light: Artiicial Evolution, Real Vision , 1994 .

[24]  Aude Billard,et al.  From Animals to Animats , 2004 .

[25]  Matthew Quinn,et al.  Evolving Communication without Dedicated Communication Channels , 2001, ECAL.

[26]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[27]  Ezequiel A. Di Paolo,et al.  Behavioral Coordination, Structural Congruence and Entrainment in a Simulation of Acoustically Coupled Agents , 2000, Adapt. Behav..

[28]  Dave Cliff,et al.  On simulating the evolution of communication , 1996 .

[29]  Aude Billard,et al.  Experiments in Learning by Imitation - Grounding and Use of Communication in Robotic Agents , 1999, Adapt. Behav..

[30]  L. Steels.  Evolving grounded communication for robots , 2003, Trends in Cognitive Sciences.

[31]  Simon Kirby,et al.  Spontaneous evolution of linguistic structure-an iterated learning model of the emergence of regularity and irregularity , 2001, IEEE Trans. Evol. Comput..

[32]  Angelo Cangelosi,et al.  Evolution of communication and language using signals, symbols, and words , 2001, IEEE Trans. Evol. Comput..

[33]  M Oliphant,et al.  The dilemma of Saussurean communication. , 1996, Bio Systems.

[34]  J. Baldwin.  A New Factor in Evolution , 1896, The American Naturalist.

[35]  Domenico Parisi,et al.  Cultural Evolution in a Population of Neural Networks , 1997 .

[36]  Sandip Sen,et al.  Co-adaptation in a Team , 1997 .

[37]  Hiroyuki Iizuka,et al.  Simulating autonomous coupling in discrimination of light frequencies , 2004, Connect. Sci..

[38]  Stefano Nolfi,et al.  Active perception: a sensorimotor account of object categorization , 2002 .

[39]  Simon Kirby,et al.  Natural Language From Artificial Life , 2002, Artificial Life.

[40]  Domenico Parisi,et al.  Language, Altruism and Docility: How Cultural Learning Can Favour Language Evolution , 2004 .

[41]  G. M. Werner.  Evolution of Communication in Artificial Organisms, Artifial Life II , 1991 .

[42]  Stefano Nolfi,et al.  Evolving Mobile Robots Able to Display Collective Behaviors , 2003, Artificial Life.

[43]  Brian Hazlehurst,et al.  How to invent a lexicon: the development of shared symbols in interaction , 2006 .

[44]  Luc Steels,et al.  Language re-entrance and the 'inner voice'. , 2003 .

[45]  Stefano Nolfi,et al.  EMERGENCE OF COMMUNICATION IN EMBODIED AGENTS: CO-ADAPTING COMMUNICATIVE AND NON-COMMUNICATIVE BEHAVIOURS , 2005 .

[46]  Karl Sims,et al.  Evolving 3D Morphology and Behavior by Competition , 1994, Artificial Life.

[47]  Tom Ziemke,et al.  Social Situatedness of Natural and Artificial Intelligence: Vygotsky and Beyond , 2003, Adapt. Behav..

[48]  Sandip Sen,et al.  Evolving Beharioral Strategies in Predators and Prey , 1995, Adaption and Learning in Multi-Agent Systems.

[49]  C. Waddington.  Canalization of Development and the Inheritance of Acquired Characters , 1942, Nature.

[50]  Stefano Nolfi,et al.  Evolving robots able to self-localize in the environment: the importance of viewing cognition as the result of processes occurring at different time-scales , 2002 .

[51]  Aude Billard,et al.  LEARNING MOTOR SKILLS BY IMITATION: A BIOLOGICALLY INSPIRED ROBOTIC MODEL , 2001, Cybern. Syst..

[52]  Brian Hazlehurst,et al.  Learning in the Cultural Process , 2000 .

[53]  Lincoln Smith,et al.  Evolving controllers for a homogeneous system of physical robots: structured cooperation with minimal sensors , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[54]  Ezequiel A. Di Paolo,et al.  An Investigation into the Evolution of Communication , 1998, Adapt. Behav..

[55]  James A. Reggia,et al.  Progress in the Simulation of Emergent Communication and Language , 2003, Adapt. Behav..

[56]  David H. Ackley,et al.  Interactions between learning and evolution , 1991 .

[57]  Luc Steels,et al.  Grounding adaptive language games in robotic agents , 1997 .

[58]  Stefano Nolfi,et al.  Co-evolving predator and prey robots , 1998, Artificial Life.

[59]  Stefano Nolfi,et al.  Learning and Evolution , 1999, Auton. Robots.

[60]  Angelo Cangelosi,et al.  The Emergence of a 'Language' in an Evolving Population of Neural Networks , 1998, Connect. Sci..