Linguistic Determinants of Word Colouring in Grapheme-Colour Synaesthesia

Previous studies of grapheme-colour synaesthesia have suggested that words tend to be coloured by their initial letter or initial vowel (e.g., Baron-Cohen et al., 1993; Ward et al., 2005). We examine this assumption in two ways. First, we show that letter position and syllable stress have been confounded, such that the initial letters of a word are often in stressed position (e.g., 'wo-man, 'ta-ble, 'ha-ppy). With participant JW, we separate these factors (e.g., with stress homographs such as 'con-vict vs. con-'vict) and show that the primary determinant of word colour is syllable stress, with only a secondary influence of letter position. We show that this effect derives from conceptual rather than perceptual stress, and that the effect is more prominent for synaesthetes whose words are coloured by vowels than by consonants. We examine, too, the time course of word colour generation. Slower colour naming occurs for spoken versus written stimuli, as we might expect from the additional requirement of grapheme conversion in the former. Reaction time data provide evidence, too, of incremental processing, since word colour is generated faster when the dominant grapheme is flagged early rather than late in the spoken word. Finally, we examine the role of non-dominant graphemes in word colouring and show faster colour naming when later graphemes match the dominant grapheme (e.g., ether) compared to when they do not (e.g., ethos). Taken together, our findings suggest that words are coloured incrementally by a process of competition between constituent graphemes, in which stressed graphemes and word-initial graphemes are disproportionately weighted.

[1]  W. Marslen-Wilson Functional parallelism in spoken word-recognition , 1987, Cognition.

[2]  M. Coltheart,et al.  Serial processing in reading aloud: Evidence for dual-route models of reading. , 1994 .

[3]  Jamie Ward,et al.  Lexical-gustatory synaesthesia: linguistic and conceptual factors , 2003, Cognition.

[4]  G. Altmann,et al.  Cognitive Models of Speech Processing: Psycholinguistic and Computational Perspectives - Workshop Overview , 1989, AI Mag..

[5]  Ronald A. Cole,et al.  Sound and spelling in spoken word recognition. , 1985 .

[6]  L. Marks The Unity of the Senses , 1978 .

[7]  H. Kucera,et al.  Computational analysis of present-day American English , 1967 .

[8]  A W Ellis,et al.  Contrasting effects of age of acquisition and word frequency on auditory and visual lexical decision , 1998, Memory & cognition.

[9]  A. Cutler,et al.  Rhythmic cues to speech segmentation: Evidence from juncture misperception , 1992 .

[10]  E. T. Bullmore,et al.  Functional magnetic resonance imaging of synesthesia: activation of V4/V8 by spoken words , 2002, Nature Neuroscience.

[11]  S. Baron-Cohen,et al.  Hearing Words and Seeing Colours: An Experimental Investigation of a Case of Synaesthesia , 1987, Perception.

[12]  Jason B. Mattingley,et al.  Anomalous perception in synaesthesia: A cognitive neuroscience perspective , 2002, Nature Reviews Neuroscience.

[13]  Marcus Taft,et al.  Lexical access-via an orthographic code: The basic orthographic syllabic structure (BOSS) , 1979 .

[14]  Anne Cutler,et al.  Exploiting prosodic probabilities in speech segmentation , 1991 .

[15]  S Baron-Cohen,et al.  The physiology of coloured hearing. A PET activation study of colour-word synaesthesia. , 1995, Brain : a journal of neurology.

[16]  A. Caramazza,et al.  Lexical organization of nouns and verbs in the brain , 1991, Nature.

[17]  M Mason,et al.  Recognition time for letters and nonletters: effects of serial position, array size, and processing order. , 1982, Journal of experimental psychology. Human perception and performance.

[18]  J. Gee,et al.  Prosodic structure and spoken word recognition , 1987, Cognition.

[19]  Harold Goodglass,et al.  The Role of Prosody in the Mental Lexicon , 1999, Brain and Language.

[20]  Anne Cutler,et al.  The role of strong syllables in segmentation for lexical access , 1988 .

[21]  Gerry Altmann,et al.  Cognitive Models of Speech Processing: Psycholinguistic and Computational Perspectives - Workshop Overview , 1989, AI Mag..

[22]  Pierre A. Hallé,et al.  Where Is the /b/ in “absurde” [apsyrd]? It Is in French Listeners' Minds , 2000 .

[23]  Christopher T. Lovelace,et al.  Mechanisms of synesthesia: cognitive and physiological constraints , 2001, Trends in Cognitive Sciences.

[24]  A. H. Pierce,et al.  Gustatory Audition; A Hitherto Undescribed Variety of Synaesthesia , 1907 .

[25]  Jamie Ward,et al.  A comparison of lexical-gustatory and grapheme-colour synaesthesia , 2005, Cognitive neuropsychology.

[26]  V. Ramachandran,et al.  Psychophysical investigations into the neural basis of synaesthesia , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[27]  M. H. Kelly,et al.  Stress in time. , 1988, Journal of experimental psychology. Human perception and performance.

[28]  Steven C.R. Williams,et al.  Implications of synaesthesia for functionalism - Theory and experiments , 2002 .

[29]  Mark S. Seidenberg,et al.  Multiple code activation in word recognition: evidence from rhyme monitoring. , 1981, Journal of experimental psychology. Human learning and memory.

[30]  Simon Baron-Cohen,et al.  Synaesthesia : classic and contemporary readings , 1997 .

[31]  A. Samuel,et al.  How lexical stress affects speech segmentation and interactivity : Evidence from the migration paradigm , 1997 .

[32]  W. Ritter,et al.  Lexical processing of visually and auditorily presented nouns and verbs: evidence from reaction time and N400 priming data. , 1997, Brain research. Cognitive brain research.

[33]  Leslie Henderson,et al.  On the use of the term ‘grapheme’ , 1985 .

[34]  Harold Goodglass,et al.  The contribution of prosody to spoken word recognition , 1999, Applied Psycholinguistics.

[35]  Max Coltheart Writing Systems and Reading Disorders , 1984 .

[36]  P. Luce,et al.  A computational analysis of uniqueness points in auditory word recognition , 1986, Perception & psychophysics.

[37]  P. Herzig,et al.  Hydrothermal activity and metallogenesis in the Lau back-arc basin , 1991, Nature.

[38]  E. Bullmore,et al.  Functional magnetic resonance imaging of synesthesia : activation of V 4 / V 8 by spoken words , 2002 .

[39]  S. Baron-Cohen,et al.  Coloured Speech Perception: Is Synaesthesia what Happens when Modularity Breaks Down? , 1993, Perception.

[40]  V. Ramachandran,et al.  Synaesthesia? A window into perception, thought and language , 2001 .