The Bouba Effect: Sound-Shape Iconicity in Iterated and Implicit Learning

The Bouba Effect: Sound-Shape Iconicity in Iterated and Implicit Learning Matthew Jones a (john.jones.09@ucl.ac.uk), David Vinson a (d.vinson@ucl.ac.uk) , Nourane Clostre a (n.clostre@ucl.ac.uk), Alex Lau Zhu a (a.zhu@ucl.ac.uk), Julio Santiago b (santiago@ugr.es), Gabriella Vigliocco a (g.vigliocco@ucl.ac.uk) a Division of Psychology and Language Sciences, University College London, London WC1E 6BT, UK b Dept. de Psicologia Experimental y Fisiologia del Comportamiento, Facultad de Psicologia, Universidad de Granada, Campus de Cartuja s/n 180179-Granada, SPAIN labels in adults (Perniss et al, 2010). In spoken languages: iconicity facilitates word processing in adults (Westbury, 2005); 3- to 4-month-old infants are sensitive to iconic mappings (Walker et al., 2010); and iconic words are easier for 3-year-olds to learn than non-iconic words (Imai et al., 2008). This is unsurprising given an embodied perspective: if the semantics of words depend on sensorimotor activation, then words with forms that generate appropriate activation will automatically be more learnable than arbitrary words, and will enjoy easier encoding, storage, and retrieval (Perniss and Vigliocco, in press). Abstract Although wordforms are often arbitrarily linked to their meaning, many exhibit iconicity (resemblance between form and meaning). This is especially visible in the lexica of non- Indo-European languages and signed languages. Iconicity has been argued to play a role in grounding linguistic form to real-world experience, rendering language more learnable (Perniss & Vigliocco, in press). Here we examine sound- shape iconicity, the ‘kiki-bouba’ effect, i.e. the tendency to associate bouba-type labels with round shapes, and kiki-type labels with spiky shapes. In a first experiment we show that this iconicity emerges in the course of iterated learning (presumably because it renders labels more learnable). However, it only emerges for the mapping between round shapes and bouba-type labels. In a second experiment (using cross-situational learning, see Monaghan et al., 2012) greater learnability is observed for mappings of the bouba-to-round type but not of the kiki-to-spiky type. We discuss possible mechanisms underlying this difference. Sound-Shape Iconicity Keywords: cross-modal; cultural evolution; iconicity; iterated learning; language evolution; sound symbolism. Introduction Iconicity as a Widespread Feature of Language The arbitrariness of wordform has often had the status of a truism (de Saussure, 1983). However, wordforms are often motivated by iconic relationships with meaning. In English, iconicity can be found in onomatopoeia, (e.g. bang, miaow). However, in languages outside the Indo-European family, iconicity is more pervasive. Large iconic or sound-symbolic lexica are reported for many unrelated languages (including sub-Saharan African languages, Australian Aboriginal languages, and Japanese and Korean; see Perniss Thompson, & Vigliocco, 2010). Iconicity is not limited to resemblance between sounds. In Japanese, reduplication of syllables often indicates repetition of an event, and voicing of an initial consonant can indicate object size (e.g. gorogoro – a heavy object rolling repeatedly; korokoro – a light object rolling repeatedly; Perniss et al., 2010). Given the hands’ potential for mimesis, it is unsurprising that signed languages are rich in iconicity (see Perniss et al., 2010 for a review). E.g. in British Sign Language, the sign for hammer is a hammering gesture, and the sign for lion uses the hands to mimic the pouncing cat’s paws. There is evidence, especially in sign languages, that iconic mappings facilitate learning and processing of novel A seemingly universal form of iconicity is the association between certain sounds (e.g. back vowels and voiced consonants) with heavy, slow, rounded objects; and others (e.g. front vowels and voiceless consonants) with small, quick, jagged objects (Ramachandran & Hubbard, 2001). In standard demonstrations, participants (being adult speakers of English, 4 month old infants, or people in non-literate, non-industrial societies) are given images of two 2- dimensional shapes, one round, the other spiky. The majority prefers to associate ‘kiki’ with a spiky shape, and ‘bouba’ with a round shape. (Maurer, Pathman, & Mondloch, 2006; Ozturk, Krehm, & Vouloumanos, 2013; Bremner et al., 2012). Similar shape-sound associations obtain when the methodology used is implicit learning (Monaghan, Mattock, & Walker, 2012). The origin of this sound-shape iconicity is, however, uncertain. It could be argued that the effect arises from multisensory statistics, with certain shapes co-occuring with certain sounds in the environment, but that such correlations exist is far from clear (see Spence & Deroy, 2012, for discussion). Ramachandran and Hubbard (2001) suggest that the effect is a reflection of cross-modal analogy between the articulatory gestures required to produce the labels and the visual properties of the shapes, implying that non-visual representation of articulation mediates between sound and shape (p. 19). Alternatively, they also suggest that ‘cross-wiring’ (p. 21) of auditory and visual brain maps may create an unmediated link (with associations depending on features of brain architecture). Both of these accounts predict that the effect is present for both ‘kiki’-spiky and ‘bouba’-round. There is, however, yet another possible explanation: associations between speech sounds and lip shape. Words

[1]  Gert Westermann,et al.  The shape of words in the brain , 2010, Cognition.

[2]  V. Ramachandran,et al.  Synaesthesia? A window into perception, thought and language , 2001 .

[3]  F. Saussure,et al.  Course in General Linguistics , 1960 .

[4]  G. Vigliocco,et al.  The bridge of iconicity: from a world of experience to the experience of language , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  W. Köhler Gestalt psychology , 1967 .

[6]  C. Westbury Implicit sound symbolism in lexical access: Evidence from an interference task , 2005, Brain and Language.

[7]  Linda B. Smith,et al.  Rapid Word Learning Under Uncertainty via Cross-Situational Statistics , 2007, Psychological science.

[8]  Charles Spence,et al.  ‘Bouba’ and ‘Kiki’ in Namibia? A remote culture make similar shape–sound matches, but different shape–taste matches to westerners , 2013 .

[9]  S. Kirby,et al.  Language evolution in the laboratory , 2010, Trends in Cognitive Sciences.

[10]  S. Kita,et al.  Sound symbolism facilitates early verb learning , 2008, Cognition.

[11]  Ferdinand de Saussure Course in General Linguistics , 1916 .

[12]  Simon Kirby,et al.  Cumulative cultural evolution in the laboratory: An experimental approach to the origins of structure in human language , 2008, Proceedings of the National Academy of Sciences.

[13]  Morten H. Christiansen,et al.  Language as shaped by the brain. , 2008, The Behavioral and brain sciences.

[14]  P. Walker,et al.  The role of sound symbolism in language learning. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[15]  Ophelia Deroy,et al.  Hearing mouth shapes: Sound symbolism and the reverse McGurk effect , 2012, i-Perception.

[16]  D. Maurer,et al.  The shape of boubas: sound-shape correspondences in toddlers and adults. , 2006, Developmental science.

[17]  Gabriella Vigliocco,et al.  Iconicity as a General Property of Language: Evidence from Spoken and Signed Languages , 2010, Front. Psychology.

[18]  A. Vouloumanos,et al.  Sound symbolism in infancy: evidence for sound-shape cross-modal correspondences in 4-month-olds. , 2013, Journal of experimental child psychology.

[19]  Scott P. Johnson,et al.  Preverbal Infants’ Sensitivity to Synaesthetic Cross-Modality Correspondences , 2010, Psychological science.