Perspectives on Learning Symbolic Data with Connectionistic Systems

For highly social organisms such as primates (including humans), cetaceans (whales and dolphins), and others, social learning, the ability to learn from others, is a powerful mechanism complementing and supporting individual learning. Also, in many species social learning and imitation provide the basis for culture, where behavior, ideas, or beliefs etc. are spreading within a population and passed down from generation to generation. One type of social learning has attracted particular attention among biologists and psychologists: imitation. For many years discussions on imitation in animals have focused on trying to define imitation, in particular trying to identify how it differs from other types of social learning. Some researchers, e.g. (Blackmore 1999), view imitation as a crucial mechanism for transmitting memes (the units of cultural evolution, analogous to the role genes play in biological evolution, Dawkins 1976). To what extent imitation is special to the human species is highly controversial (Blackmore 1999, Reader and Laland 1999); see also Sect. 1.2 below.

[1]  W. Thorpe Learning and instinct in animals , 1956 .

[2]  M. Tomasello Uniquely primate, uniquely human , 1998 .

[3]  Sandiway Fong,et al.  Can recurrent neural networks learn natural language grammars? , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[4]  William R. Harcombe,et al.  Frequency-dependent Batesian mimicry , 2001, Nature.

[5]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[6]  Tony A. Plate,et al.  Holographic reduced representations , 1995, IEEE Trans. Neural Networks.

[7]  R. Byrne,et al.  Priming primates: Human and otherwise , 1998, Behavioral and Brain Sciences.

[8]  Edmund Furse,et al.  A MODEL OF IMITATION LEARNING OF ALGORITHMS FROM WORKED EXAMPLES , 2001, Cybern. Syst..

[9]  K. Dautenhahn,et al.  Vocal, Social, and Self-Imitation by Bottlenosed Dolphins , 2002 .

[10]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[11]  C. K. Tayler,et al.  Imitative Behaviour By Indian Ocean Bottlenose Dolphins (t uRsiops Aduncus) in Captivity , 1973 .

[12]  Aude Billard,et al.  LEARNING MOTOR SKILLS BY IMITATION: A BIOLOGICALLY INSPIRED ROBOTIC MODEL , 2001, Cybern. Syst..

[13]  Barbara Hammer,et al.  On approximate learning by multi-layered feedforward circuits , 2005, Theor. Comput. Sci..

[14]  Hava T. Siegelmann,et al.  The Dynamic Universality of Sigmoidal Neural Networks , 1996, Inf. Comput..

[15]  Thomas R. Zentall,et al.  IMITATION IN ANIMALS: EVIDENCE, FUNCTION, AND MECHANISMS , 2001, Cybern. Syst..

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Billard Aude.,et al.  Drama, a connectionist model for robot learning: experiments on grounding communication through imitation in autonomous robots , 1999 .

[18]  E. Visalberghi,et al.  Social processes affecting the appearance of innovative behaviors in capuchin monkeys. , 1990, Folia primatologica; international journal of primatology.

[19]  Mathukumalli Vidyasagar,et al.  A Theory of Learning and Generalization , 1997 .

[20]  R. W. Mitchell,et al.  A Comparative-Developmental Approach to Understanding Imitation , 1987 .

[21]  Chrystopher L. Nehaniv,et al.  Imitation as a Dual-Route Process Featuring Predictive and Learning Components: A Biologically Plausible Computational Model , 2002 .

[22]  C. Darwin The descent of man, and Selection in relation to sex, Vol 1. , 1871 .

[23]  A. Meltzoff,et al.  Early Imitation Within a Functional Framework: The Importance of Person Identity, Movement, and Development. , 1992, Infant behavior & development.

[24]  Barbara Hammer,et al.  Approximation and generalization issues of recurrent networks dealing with structured data , 2000 .

[25]  Chrystopher L. Nehaniv,et al.  Like Me?- Measures of Correspondence and Imitation , 2001, Cybern. Syst..

[26]  Masayuki Inaba,et al.  Design and implementation of a system that generates assembly programs from visual recognition of human action sequences , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[27]  Irene M. Pepperberg,et al.  Allospecific referential speech acquisition in Grey parrots (psittacus erithacus): evidence for multiple levels of avian vocal imitation , 2002 .

[28]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[29]  T. Zentall CHAPTER 11 – An Analysis of Imitative Learning in Animals , 1996 .

[30]  Eduardo D. Sontag,et al.  Neural Networks with Quadratic VC Dimension , 1995, J. Comput. Syst. Sci..

[31]  Ronald J. Williams,et al.  Gradient-based learning algorithms for recurrent networks and their computational complexity , 1995 .

[32]  K. Dautenhahn,et al.  Trying to imitate-a step towards releasing robots from social isolation , 1994, Proceedings of PerAc '94. From Perception to Action.

[33]  C. Heyes,et al.  A Demonstration of Observational Learning in Rats using a Bidirectional Control , 1990, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[34]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[35]  C. Heyes CHAPTER 10 – Introduction: Identifying and Defining Imitation , 1996 .

[36]  D. Perrett,et al.  Imitation, mirror neurons and autism , 2001, Neuroscience & Biobehavioral Reviews.

[37]  Barak A. Pearlmutter Gradient calculations for dynamic recurrent neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[38]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[39]  Kenneth Mark Colby,et al.  Clinical artificial intelligence , 1981, Behavioral and Brain Sciences.

[40]  D. Sherry,et al.  Cultural transmission without imitation: Milk bottle opening by birds , 1984, Animal Behaviour.

[41]  Jude W. Shavlik,et al.  Using Sampling and Queries to Extract Rules from Trained Neural Networks , 1994, ICML.

[42]  Barbara Hammer,et al.  Learning with recurrent neural networks , 2000 .

[43]  Kerstin Dautenhahn,et al.  Imitation in Natural and Artificial Systems , 2001, Cybern. Syst..

[44]  Kerstin Dautenhahn,et al.  Learning how to do things with imitation , 2000 .

[45]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[46]  C. Heyes,et al.  Imitation in Rats: Initial Responding and Transfer Evidence , 1992 .

[47]  C. Heyes,et al.  Limitations of a Bidirectional Control Procedure for the Investigation of Imitation in Rats: Odour Cues on the Manipulandum , 1999 .

[48]  I. Pepperberg The Alex Studies: Cognitive and Communicative Abilities of Grey Parrots , 2000 .

[49]  B. Voelkl,et al.  True imitation in marmosets , 2000, Animal Behaviour.

[50]  Josep Call,et al.  BODY IMITATION IN AN ENCULTURATED ORANGUTAN (PONGO PYGMAEUS) , 2001, Cybern. Syst..

[51]  K. Laland,et al.  Do Animals Have Memes , 1999 .

[52]  E. Thorndike “Animal Intelligence” , 1898, Nature.

[53]  Sorin Moga,et al.  From Perception-Action Loops to Imitation Processes: A Bottom-Up Approach of Learning by Imitation , 1998, Appl. Artif. Intell..

[54]  T. Tregenza,et al.  Dynamic mimicry in an Indo–Malayan octopus , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[55]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[56]  G. Butterworth Neonatal imitation: Existence, mechanisms and motives. , 1999 .

[57]  Kerstin Dautenhahn,et al.  Getting to know each other - Artificial social intelligence for autonomous robots , 1995, Robotics Auton. Syst..

[58]  Steve Reilly,et al.  Long-Term Memory of Pigeons for Stimulus-Outcome Associations Involving Multiple Stimuli, each Seen in a Single Brief Trial , 1992 .

[59]  R. Byrne Imitation without intentionality. Using string parsing to copy the organization of behaviour , 1999, Animal Cognition.

[60]  Monica N. Nicolescu,et al.  Learning and interacting in human-robot domains , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[61]  Eduardo D. Sontag,et al.  Analog Neural Nets with Gaussian or Other Common Noise Distributions Cannot Recognize Arbitrary Regular Languages , 1999, Neural Computation.

[62]  J. Uexküll Umwelt und Innenwelt der Tiere , 1921 .

[63]  Aude Billard,et al.  Grounding communication in autonomous robots: An experimental study , 1998, Robotics Auton. Syst..

[64]  C. Lee Giles,et al.  Constructing deterministic finite-state automata in recurrent neural networks , 1996, JACM.

[65]  Hava T. Siegelmann,et al.  The Simple Dynamics of Super Turing Theories , 1996, Theor. Comput. Sci..

[66]  Aude Billard,et al.  Experiments in social robotics: grounding and use of communication in autonomous agents , 2000 .

[67]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[68]  R. Brooks,et al.  The cog project: building a humanoid robot , 1999 .

[69]  John Demiris,et al.  Movement imitation mechanisms in robots and humans , 1999 .

[70]  T. Caro,et al.  Is There Teaching in Nonhuman Animals? , 1992, The Quarterly Review of Biology.

[71]  M Reczko,et al.  Protein secondary structure prediction with partially recurrent neural networks. , 1993, SAR and QSAR in environmental research.

[72]  A. Meltzoff Chapter 16 - The Human Infant as Imitative Generalist: A 20-Year Progress Report on Infant Imitation with Implications for Comparative Psychology , 1996 .

[73]  M. Tomasello,et al.  Imitative learning of actions on objects by children, chimpanzees, and enculturated chimpanzees. , 1993, Child development.

[74]  William R. Harcombe,et al.  Frequency-dependent Batesian mimicry: Predators avoid look-alikes of venomous snakes only when the real thing is around , 2001 .

[75]  Kerstin Dautenhahn,et al.  Of hummingbirds and helicopters: An algebraic framework for interdisciplinary studies of imitation a , 2000 .

[76]  Anne E. Russon,et al.  Constraints on great apes' imitation: model and action selectivity in rehabilitant orangutan (Pongo pygmaeus) imitation. , 1995 .

[77]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.