Glyph guessing for ‘oo’ and ‘ee’: spatial frequency information in sound symbolic matching for ancient and unfamiliar scripts

In three experiments, we asked whether diverse scripts contain interpretable information about the speech sounds they represent. When presented with a pair of unfamiliar letters, adult readers correctly guess which is /i/ (the ‘ee’ sound in ‘feet’), and which is /u/ (the ‘oo’ sound in ‘shoe’) at rates higher than expected by chance, as shown in a large sample of Singaporean university students (Experiment 1) and replicated in a larger sample of international Internet users (Experiment 2). To uncover what properties of the letters contribute to different scripts' ‘guessability,’ we analysed the visual spatial frequencies in each letter (Experiment 3). We predicted that the lower spectral frequencies in the formants of the vowel /u/ would pattern with lower spatial frequencies in the corresponding letters. Instead, we found that across all spatial frequencies, the letter with more black/white cycles (i.e. more ink) was more likely to be guessed as /u/, and the larger the difference between the glyphs in a pair, the higher the script's guessability. We propose that diverse groups of humans across historical time and geographical space tend to employ similar iconic strategies for representing speech in visual form, and provide norms for letter pairs from 56 diverse scripts.

[1]  M. A. Bee,et al.  Male green frogs lower the pitch of acoustic signals in defense of territories: a possible dishonest signal of size? , 2000 .

[2]  A. Majid,et al.  Prelinguistic Infants Are Sensitive to Space-Pitch Associations Found Across Cultures , 2014, Psychological science.

[3]  Annette D'Onofrio,et al.  Phonetic Detail and Dimensionality in Sound-shape Correspondences: Refining the Bouba-Kiki Paradigm , 2014 .

[4]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[5]  Alan Nielsen,,et al.  The source and magnitude of sound-symbolic biases in processing artificial word material and their implications for language learning and transmission , 2012, Language and Cognition.

[6]  S. Levinson,et al.  WEIRD languages have misled us, too , 2010, Behavioral and Brain Sciences.

[7]  D. Maurer,et al.  The shape of boubas: sound-shape correspondences in toddlers and adults. , 2006, Developmental science.

[8]  Gabriella Vigliocco,et al.  Iconicity as a General Property of Language: Evidence from Spoken and Signed Languages , 2010, Front. Psychology.

[9]  Lorijn Zaadnoordijk,et al.  Sound-Symbolism is Disrupted in Dyslexia: Implications for the Role of Cross-Modal Abstraction Processes , 2015, CogSci.

[10]  D. Maurer Neonatal Synesthesia: Implications for the Processing of Speech And Faces , 1993 .

[11]  P. Hsieh,et al.  Can a Word Sound Like a Shape Before You Have Seen It? Sound-Shape Mapping Prior to Conscious Awareness , 2017, Psychological science.

[12]  D. Rendall,et al.  Parsing the role of consonants versus vowels in the classic Takete-Maluma phenomenon. , 2013, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[13]  C. B. Colby The weirdest people in the world , 1973 .

[14]  Morten H. Christiansen,et al.  Arbitrariness, Iconicity, and Systematicity in Language , 2015, Trends in Cognitive Sciences.

[15]  Asifa Majid,et al.  Spatial metaphor in language can promote the development of cross-modal mappings in children. , 2014, Developmental science.

[16]  M. M. Taylor,et al.  Another look at phonetic symbolism. , 1965, Psychological bulletin.

[17]  Linda Polka,et al.  Asymmetries in vowel perception , 2003, Speech Commun..

[18]  Catherine J. Stevens,et al.  Extracting Meaning from Sound: Nomic Mappings, Everyday Listening, and Perceiving Object Size from Frequency , 2004 .

[19]  Robert H. Cohen,et al.  The Meanings of Consonants , 2003 .

[20]  T. Matsuzawa,et al.  Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (Pan troglodytes) and humans , 2011, Proceedings of the National Academy of Sciences.

[21]  Leo Blomert,et al.  The neural signature of orthographic–phonological binding in successful and failing reading development , 2011, NeuroImage.

[22]  E. Sapir A study in phonetic symbolism. , 1929 .

[23]  Sharon Peperkamp,et al.  Consonants are More Important than Vowels in the Bouba-kiki Effect , 2015, Language and speech.

[24]  J. Mehler,et al.  The Role of Audiovisual Processing in Early Conceptual Development , 2011, Psychological science.

[25]  Charles Spence,et al.  Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test , 2012, Experimental Brain Research.

[26]  S. Brem,et al.  Neural initialization of audiovisual integration in prereaders at varying risk for developmental dyslexia , 2017, Human brain mapping.

[27]  Daphne Maurer,et al.  Do small white balls squeak? Pitch-object correspondences in young children , 2004, Cognitive, affective & behavioral neuroscience.

[28]  Styles Suzy Psychoacoustic correlates of speech-sound/shape/size mapping in a 121-alternative forced-choice task (Conference Poster) , 2016 .

[29]  C. Westbury Implicit sound symbolism in lexical access: Evidence from an interference task , 2005, Brain and Language.

[30]  T. Stanford,et al.  Development of multisensory integration from the perspective of the individual neuron , 2014, Nature Reviews Neuroscience.

[31]  L E Marks,et al.  Perceiving similarity and comprehending metaphor. , 1988, Monographs of the Society for Research in Child Development.

[32]  Anne Treisman,et al.  Natural cross-modal mappings between visual and auditory features. , 2011, Journal of vision.

[33]  Asher Koriat,et al.  The symbolic implications of vowels and of their orthographic representations in two natural languages , 1977 .

[34]  L. Nygaard,et al.  Cross-linguistic sound symbolism and crossmodal correspondence: Evidence from fMRI and DTI , 2014, Brain and Language.

[35]  Suzy J. Styles,et al.  To call a cloud ‘cirrus’: sound symbolism in names for categories or items , 2017, PeerJ.

[36]  I K TAYLOR,et al.  Phonetic symbolism re-examined. , 1963, Psychological bulletin.

[37]  M. Snowling,et al.  The development of grapheme-phoneme correspondence in normal and dyslexic readers. , 1980, Journal of experimental child psychology.

[38]  Penny M. Pexman,et al.  A Prime Example of the Maluma/Takete Effect? Testing for Sound Symbolic Priming , 2017, Cogn. Sci..

[39]  E. Erdfelder,et al.  Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses , 2009, Behavior research methods.

[40]  C. Spence,et al.  “Bouba” and “Kiki” in Namibia? A remote culture make similar shape–sound matches, but different shape–taste matches to Westerners , 2013, Cognition.

[41]  Lauren Gawne,et al.  When Does Maluma/Takete Fail? Two Key Failures and a Meta-Analysis Suggest That Phonology and Phonotactics Matter , 2017, i-Perception.

[42]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[43]  J. Werker,et al.  Cross-language speech perception: Evidence for perceptual reorganization during the first year of life , 1984 .

[44]  Scott P. Johnson,et al.  Preverbal Infants’ Sensitivity to Synaesthetic Cross-Modality Correspondences , 2010, Psychological science.

[45]  P. Ladefoged A course in phonetics , 1975 .

[46]  William W. Gaver How Do We Hear in the World?: Explorations in Ecological Acoustics , 1993 .

[47]  Tal Makovski,et al.  The visual attractor illusion. , 2010, Journal of vision.

[48]  S. Kita,et al.  Sound symbolism facilitates early verb learning , 2008, Cognition.

[49]  David Deterding An instrumental study of the monophthong vowels of Singapore English , 2003 .

[50]  Julia Simner,et al.  What is the link between synaesthesia and sound symbolism? , 2015, Cognition.

[51]  Alan Nielsen Sound symbolism and the Bouba-Kiki effect : uniting function and mechanism in the search for language universals , 2011 .

[52]  A. Vouloumanos,et al.  Sound symbolism in infancy: evidence for sound-shape cross-modal correspondences in 4-month-olds. , 2013, Journal of experimental child psychology.

[53]  M. Sigman,et al.  Opinion TRENDS in Cognitive Sciences Vol.9 No.7 July 2005 The neural code for written words: a proposal , 2022 .

[54]  Simon Kirby,et al.  Phonological and orthographic influences in the bouba–kiki effect , 2017, Psychological research.

[55]  Andrej M. Savić,et al.  Balloons and bavoons versus spikes and shikes: ERPs reveal shared neural processes for shape–sound-meaning congruence in words, and shape–sound congruence in pseudowords , 2015, Brain and Language.

[56]  J. Morton,et al.  Developmental Neurocognition: Speech and Face Processing in the First Year of Life , 2008 .

[57]  V. Ramachandran,et al.  Synaesthesia? A window into perception, thought and language , 2001 .

[58]  H. Lyytinen,et al.  Brain sensitivity to print emerges when children learn letter–speech sound correspondences , 2010, Proceedings of the National Academy of Sciences.

[59]  C. Spence,et al.  Auditory contributions to multisensory product perception , 2006 .

[60]  C. Spence,et al.  When “Bouba” equals “Kiki”: Cultural commonalities and cultural differences in sound-shape correspondences , 2016, Scientific Reports.

[61]  J. Doyle,et al.  Mixed Messages in Brand Names: Separating the Impacts of Letter Shape from Sound Symbolism , 2011 .

[62]  W. Köhler Gestalt psychology , 1967 .

[63]  Jason W. Osborne,et al.  Challenges for Quantitative Psychology and Measurement in the 21st Century , 2010, Front. Psychology.

[64]  Ferdinand de Saussure Course in General Linguistics , 1916 .

[65]  A. Majid,et al.  The Thickness of Musical Pitch , 2013, Psychological science.

[66]  P. Kuhl Early language acquisition: cracking the speech code , 2004, Nature Reviews Neuroscience.

[67]  Jamie Ward,et al.  Synaesthesia: The Prevalence of Atypical Cross-Modal Experiences , 2006, Perception.

[68]  L E Marks,et al.  On cross-modal similarity: auditory-visual interactions in speeded discrimination. , 1987, Journal of experimental psychology. Human perception and performance.

[69]  J. Ohala Sound symbolism: The frequency code underlies the sound-symbolic use of voice pitch , 1995 .

[70]  J. Wouters,et al.  A tractography study in dyslexia: neuroanatomic correlates of orthographic, phonological and speech processing. , 2012, Brain : a journal of neurology.

[71]  M. Wertheimer,et al.  Some Physiognomic Aspects of Naming, or, Maluma and Takete Revisited , 1964, Perceptual and motor skills.

[72]  Mutsumi Imai,et al.  Japanese Sound-Symbolism Facilitates Word Learning in English-Speaking Children , 2011, Cogn. Sci..

[73]  Simon Kirby,et al.  How arbitrary is language? , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[74]  E. Morton On the Occurrence and Significance of Motivation-Structural Rules in Some Bird and Mammal Sounds , 1977, The American Naturalist.

[75]  Abraham S. Ross,et al.  A Cross-Cultural Test of the Maluma—Takete Phenomenon , 1975, Perception.

[76]  C. Spence,et al.  Tasting shapes and words , 2011 .

[77]  Gert Westermann,et al.  The shape of words in the brain , 2010, Cognition.

[78]  Early sound symbolism for vowel sounds , 2013, i-Perception.

[79]  David J. Lewkowicz,et al.  Cross-modal equivalence in early infancy: Auditory–visual intensity matching. , 1980 .

[80]  W. Bright,et al.  The World's Writing Systems , 1997 .

[81]  D. Eagleman,et al.  Wednesday Is Indigo Blue: Discovering the Brain of Synesthesia , 2009 .

[82]  C. F. Hockett,et al.  The World's Writing Systems , 1997 .

[83]  G. Vigliocco,et al.  The bridge of iconicity: from a world of experience to the experience of language , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[84]  R D Tarte,et al.  Phonetic Symbolism in Adult Native Speakers of English: Three Studies , 1971, Language and speech.