The Iterated Classification Game: A New Model of the Cultural Transmission of Language

The iterated classification game (ICG) combines the classification game with the iterated learning model (ILM) to create a more realistic model of the cultural transmission of language through generations. It includes both learning from parents and learning from peers. Further, it eliminates some of the chief criticisms of the ILM: that it does not study grounded languages, that it does not include peer learning, and that it builds in a bias for compositional languages. We show that, over the span of a few generations, a stable linguistic system emerges that can be acquired very quickly by each generation, is compositional, and helps the agents to solve the classification problem with which they are faced. The ICG also leads to a different interpretation of the language acquisition process. It suggests that the role of parents is to initialize the linguistic system of the child in such a way that subsequent interaction with peers results in rapid convergence to the correct language.

[1]  Jürgen Schmidhuber,et al.  Flat Minima , 1997, Neural Computation.

[2]  Geoffrey E. Hinton,et al.  Keeping Neural Networks Simple , 1993 .

[3]  S. Kirby,et al.  Cultural evolution: implications for understanding the human language faculty and its evolution , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  Mariarosaria Taddeo,et al.  A Praxical Solution of the Symbol Grounding Problem , 2007, Minds and Machines.

[5]  Simon Kirby,et al.  From UG to universals: Linguistic adaptation through iterated learning , 2004 .

[6]  Stephan Lewandowsky,et al.  Introduction. Cultural transmission and the evolution of human behaviour , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[7]  Henry Brighton,et al.  Compositionality, Linguistic Evolution, and Induction by Minimum Description Length , 2005 .

[8]  Joachim De Beule.  THE EMERGENCE OF COMPOSITIONALITY, HIERARCHY AND RECURSION IN PEER-TO-PEER INTERACTIONS , 2008 .

[9]  Marian Perkins,et al.  The Nurture Assumption: Why Children Turn Out the Way They Do , 2000, BMJ : British Medical Journal.

[10]  Les Gasser,et al.  The classification game: combining supervised learning and language evolution , 2010, Connect. Sci..

[11]  Shimon Edelman,et al.  Behavioral and computational aspects of language and its acquisition , 2007 .

[12]  A. Senghas,et al.  Children Creating Core Properties of Language: Evidence from an Emerging Sign Language in Nicaragua , 2004, Science.

[13]  S. Kirby,et al.  The emergence of linguistic structure: an overview of the iterated learning model , 2002 .

[14]  Paul Vogt,et al.  On the Acquisition and Evolution of Compositional Languages: Sparse Input and the Productive Creativity of Children , 2005, Adapt. Behav..

[15]  S. Kirby,et al.  Cultural selection for learnability: Three principles underlying the view that language adapts to be learnable , 2006 .

[16]  Samarth Swarup,et al.  The Classification Game: Complexity Regularization through Interaction , 2009, COIN@AAMAS&IJCAI&MALLOW.

[17]  Ann Senghas,et al.  Intergenerational influence and ontogenetic development in the emergence of spatial grammar in Nicaraguan Sign Language , 2003 .

[18]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[19]  Ricard V. Solé,et al.  Least effort and the origins of scaling in human language , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Simon Kirby,et al.  Complex Systems in Language Evolution: the Cultural Emergence of Compositional Structure , 2003, Adv. Complex Syst..

[21]  S. Kirby.  The Evolution of Meaning-Space Structure through Iterated Learning , 2007 .

[22]  Morten H. Christiansen,et al.  Language evolution: consensus and controversies , 2003, Trends in Cognitive Sciences.

[23]  Paul Vogt,et al.  The physical symbol grounding problem , 2002, Cognitive Systems Research.

[24]  SHALOM LAPPIN,et al.  Machine learning theory and practice as a source of insight into universal grammar , 2007 .

[25]  G. Geertz.  Religion as a cultural system , 1973 .

[26]  Kenny Smith,et al.  Cultural Evolution of Language , 2006 .

[27]  Joshua B. Tenenbaum,et al.  Indirect Evidence and the Poverty of the Stimulus: The Case of Anaphoric One , 2009, Cogn. Sci..

[28]  Simon Kirby,et al.  Spontaneous evolution of linguistic structure-an iterated learning model of the emergence of regularity and irregularity , 2001, IEEE Trans. Evol. Comput..

[29]  J. Tenenbaum,et al.  Poverty of the Stimulus? A Rational Approach , 2006 .

[30]  Peter Ford Dominey.  From Sensorimotor Sequence to Grammatical Construction: Evidence from Simulation and Neurophysiology , 2005, Adapt. Behav..

[31]  Paul Vogt,et al.  The emergence of compositional structures in perceptually grounded language games , 2005, Artif. Intell..

[32]  Simon Kirby,et al.  Iterated Learning: A Framework for the Emergence of Language , 2003, Artificial Life.

[33]  Andrew R. Barron,et al.  Complexity Regularization with Application to Artificial Neural Networks , 1991 .

[34]  Tom M. Mitchell,et al.  The Need for Biases in Learning Generalizations , 2007 .

[35]  Luc Steels.  A self-organizing spatial vocabulary , 1995 .

[36]  Angelo Cangelosi,et al.  From robotic toil to symbolic theft: Grounding transfer from entry-level to higher-level categories1 , 2000, Connect. Sci..

[37]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[38]  Chrystopher L. Nehaniv,et al.  Symbol Grounding and Beyond, Third International Workshop on the Emergence and Evolution of Linguistic Communication, EELC 2006, Rome, Italy, September 30 - October 1, 2006, Proceedings , 2006, EELC.

[39]  Simon Kirby,et al.  Cultural Selection for Learnability: Three hypotheses underlying the view that language adapts to be learnable. , 2005 .

[40]  S. Kirby.  Learning , Bottlenecks and Infinity : a working model of the evolution of syntactic communication , 1999 .

[41]  Samarth Swarup,et al.  SIMPLE, BUT NOT TOO SIMPLE: LEARNABILITY VS. FUNCTIONALITY IN LANGUAGE EVOLUTION , 2008 .

[42]  Paul Vogt,et al.  Cumulative Cultural Evolution: Can We Ever Learn More? , 2006, SAB.

[43]  Kenny Smith,et al.  THE PROTOLANGUAGE DEBATE: BRIDGING THE GAP? , 2006 .

[44]  J. Harris.  Where is the child's environment? A group socialization theory of development. , 1995 .

[45]  Tommi Kärkkäinen,et al.  Robust Formulations for Training Multilayer Perceptrons , 2004, Neural Computation.

[46]  W. McGrew.  CULTURE IN NONHUMAN PRIMATES , 1998 .

[47]  T. Griffiths,et al.  A Bayesian View of Language Evolution by Iterated Learning - eScholarship , 2005 .

[48]  M. Tomasello.  The Human Adaptation for Culture , 1999 .

[49]  Michael Banton,et al.  Anthropological Approaches to the Study of Religion , 1966 .

[50]  C. Padden,et al.  The emergence of grammar: systematic structure in a new language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[51]  W. Bruce Croft.  Evolutionary Linguistics , 2008 .

[52]  S. Pinker,et al.  Natural language and natural selection , 1990, Behavioral and Brain Sciences.

[53]  Henry Brighton,et al.  Compositional Syntax From Cultural Transmission , 2002, Artificial Life.

[54]  Les Gasser,et al.  Symbol Grounding Through Cumulative Learning , 2006, EELC.

[55]  Amy L. Weiss.  Growing up with Language: How Children Learn to Talk. , 1993 .

[56]  Stevan Harnad.  The Symbol Grounding Problem , 1999, ArXiv.

[57]  Mariarosaria Taddeo,et al.  Solving the symbol grounding problem: a critical review of fifteen years of research , 2005, J. Exp. Theor. Artif. Intell..

[58]  Rekha Mirchandani,et al.  Religion as a Cultural System , 2010 .

[59]  J. Nazuno.  Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[60]  Simon Kirby,et al.  Linguistic Evolution Through Language Acquisition: Learning, bottlenecks and the evolution of recursive syntax , 2002 .

[61]  Wilhelm Freiherr von Humboldt,et al.  Linguistic variability & intellectual development , 1971 .

[62]  Simon Kirby,et al.  Innateness and culture in the evolution of language , 2006, Proceedings of the National Academy of Sciences.

[63]  Luc Steels,et al.  Emergent adaptive lexicons , 1996 .

[64]  Markus Werning,et al.  Applications to Linguistics, Psychology and Neuroscience , 2005 .