How to Bootstrap a Human Communication System

How might a human communication system be bootstrapped in the absence of conventional language? We argue that motivated signs play an important role (i.e., signs that are linked to meaning by structural resemblance or by natural association). An experimental study is then reported in which participants try to communicate a range of pre-specified items to a partner using repeated non-linguistic vocalization, repeated gesture, or repeated non-linguistic vocalization plus gesture (but without using their existing language system). Gesture proved more effective (measured by communication success) and more efficient (measured by the time taken to communicate) than non-linguistic vocalization across a range of item categories (emotion, object, and action). Combining gesture and vocalization did not improve performance beyond gesture alone. We experimentally demonstrate that gesture is a more effective means of bootstrapping a human communication system. We argue that gesture outperforms non-linguistic vocalization because it lends itself more naturally to the production of motivated signs.

[1]  S. Kita Pointing: Where language, culture, and cognition meet , 2003 .

[2]  Sophie K. Scott,et al.  Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations , 2010, Proceedings of the National Academy of Sciences.

[3]  Jill P. Morford,et al.  Insights to language from the study of gesture: A review of research on the gestural communication of non-signing deaf people , 1996 .

[4]  Mutsumi Imai,et al.  Japanese Sound-Symbolism Facilitates Word Learning in English-Speaking Children , 2011, Cogn. Sci..

[5]  Dale J. Barr,et al.  Establishing conventional communication systems: Is common knowledge necessary? , 2004, Cogn. Sci..

[6]  Anne H. Anderson,et al.  The Hcrc Map Task Corpus , 1991 .

[7]  S. Goldin-Meadow The Resilience of Language : What Gesture Creation in Deaf Children Can Tell Us About How All Children Learn Language , 2005 .

[8]  Bruno Galantucci,et al.  An Experimental Study of the Emergence of Human Communication Systems , 2005, Cogn. Sci..

[9]  Nancy J. Frishberg ARBITRARINESS AND ICONICITY: HISTORICAL CHANGE IN AMERICAN SIGN LANGUAGE , 1975 .

[10]  S. Kirby,et al.  The emergence of linguistic structure: an overview of the iterated learning model , 2002 .

[11]  E. Klima The signs of language , 1979 .

[12]  Robert M. Seyfarth,et al.  Constraints and preadaptations in the earliest stages of language evolution , 2005 .

[13]  L. Steels Evolving grounded communication for robots , 2003, Trends in Cognitive Sciences.

[14]  Vittorio Loreto,et al.  Cultural route to the emergence of linguistic categories , 2007, Proceedings of the National Academy of Sciences.

[15]  Sotaro Kita,et al.  Response to Comment on "Children Creating Core Properties of Language: Evidence from an Emerging Sign Language in Nicaragua" , 2005, Science.

[16]  M. Studdert-Kennedy Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[17]  Jon Oberlander,et al.  Foundations of Representation: Where Might Graphical Symbol Systems Come From? , 2007, Cogn. Sci..

[18]  Morten H. Christiansen,et al.  Phonological typicality influences on-line sentence comprehension , 2006, Proceedings of the National Academy of Sciences.

[19]  S. Garrod,et al.  Saying what you mean in dialogue: A study in conceptual and semantic co-ordination , 1987, Cognition.

[20]  G. Ritchie,et al.  Signalling signalhood and the emergence of communication , 2008, Cognition.

[21]  H. H. Clark,et al.  Understanding by addressees and overhearers , 1989, Cognitive Psychology.

[22]  P. MacNeilage,et al.  The frame/content theory of evolution of speech production , 1998, Behavioral and Brain Sciences.

[23]  H. H. Clark Pointing and placing. , 2003 .

[24]  R. Krauss,et al.  Concurrent feedback, confirmation, and the encoding of referents in verbal communication. , 1966, Journal of personality and social psychology.

[25]  Simon Garrod,et al.  The Interactive Evolution of Human Communication Systems , 2010, Cogn. Sci..

[26]  J. Lannoy,et al.  Gestures and Speech: Psychological Investigations , 1991 .

[27]  Philip R. Cohen,et al.  Referring as a Collaborative Process , 2003 .

[28]  C. Peirce,et al.  Collected Papers of Charles Sanders Peirce , 1936, Nature.

[29]  Susan Bowsfield The Symbolic Species: The Co-Evolution of Language and the Brain , 2004 .

[30]  Simon Garrod,et al.  The fitness and functionality of culturally evolved communication systems , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[32]  S. Garrod,et al.  Experimental semiotics: a new approach for studying the emergence and the evolution of human communication , 2010 .

[33]  M. Corballis From mouth to hand: Gesture, speech, and the evolution of right-handedness , 2003, Behavioral and Brain Sciences.

[34]  Amy S. Pollick,et al.  Ape gestures and language evolution , 2007, Proceedings of the National Academy of Sciences.

[35]  喜多 壮太郎 Pointing : where language, culture, and cognition meet , 2013 .

[36]  S. Kirby,et al.  Language evolution in the laboratory , 2010, Trends in Cognitive Sciences.

[37]  C. Padden,et al.  The emergence of grammar: systematic structure in a new language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[38]  M. Arbib From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics , 2005, Behavioral and Brain Sciences.

[39]  Bradley Walker,et al.  Can iterated learning explain the emergence of graphical symbols , 2010 .