Spoken Words Activate Cross-Linguistic Orthographic Competitors in the Absence of Phonological Overlap

Spoken Words Activate Cross-Linguistic Orthographic Competitors in the Absence of Phonological Overlap James Bartolotti (j-bartolotti@u.northwestern.edu) Natalia L. Daniel (nataliadaniel2012@u.northwestern.edu) Viorica Marian (v-marian@northwestern.edu) Northwestern University Department of Communication Sciences and Disorders 2240 Campus Drive, Evanston, IL 60208 USA Abstract Related languages, like English and Spanish, often have sim- ilar orthographies but use the same letters to represent differ- ent sounds. Learning a second language frequently involves learning additional letter-sound mappings that mismatch those in the native language. In the current study, we investigated whether L2 spoken words activate L2 orthography despite con- flict with L1 orthography-to-phonology mappings. Partici- pants first learned an artificial language with letter-sound map- pings that mismatched English (e.g., the letter ‘G’ represented the sound /h/, and the word /gufO/ was spelled ‘hane’). Next, fixations of L1 crosslinguistic orthographic competitors (e.g., ‘cane’) in response to auditory L2 input (e.g., /gufO/) were assessed using the visual world paradigm. Results showed that participants fixated L1 competitors that overlapped with L2 targets orthographically (but not phonologically) more than unrelated fillers. We conclude that second language learners can rapidly acquire novel letter-sound mappings, and words based on these mappings are integrated into the existing lex- icon where they can activate orthographic competitors in the native language. Keywords: Language processing; Language learning; Cross- linguistic competition Introduction Spoken language processing involves decoding an incoming auditory signal to access words in the mental lexicon. It’s not obvious that this process should be affected by ortho- graphic knowledge, because written language is a relatively recent invention, and is learned years after spoken language. Yet, there is evidence that orthography, once acquired, influ- ences performance on phonological tasks (Jakimik, Cole, & Rudnicky, 1985; Johnston, McKague, & Pratt, 2004; Salverda & Tanenhaus, 2010), suggesting tight interconnectivity be- tween orthography and phonology. This interconnectivity may be a source of difficulty during second language acquisi- tion, because the same letters can represent different sounds across languages. For example, the letter ‘W’ maps onto the phoneme /w/ in English, but /v/ in German (one is a labio- velar approximant, while the other is a voiced labio-dental fricative, which differs on both voicing, place, and manner of articulation). Second language learners thus need to learn and use these novel letter-sound correspondences in the ap- propriate language context, despite years of experience with a different set of mappings in their native language. Orthographic knowledge can help or hinder phonological processing, depending on the context. Literate adults per- form better than illiterate adults on metaphonological tasks such as adding or deleting sounds at the beginning of non- words (Morais, Cary, Alegria, & Bertelson, 1979), because literate adults can use their orthographic representations as a mental aid. On the other hand, orthography can also dis- tort phonological perception. French speakers are more likely to misperceive the phoneme /p/ as a /b/ in spoken words when the sound is represented by the letter ‘B’, as in the French word ‘absurd,’ pronounced /apsyrd/ (Hall´e, Ch´ereau, & Segui, 2000). Furthermore, orthography can affect online processing of speech. Orthographically-related primes im- prove auditory lexical decision times (Jakimik et al., 1985), but written words can act as competitors during auditory vi- sual world search tasks (Salverda & Tanenhaus, 2010). Based on timecourse analyses from research on event-related po- tentials (ERPs), these orthographic effects occur early in the speech signal and are time-locked to the source of ortho- graphic effects in the word, suggesting that orthography is activated online during speech processing, and not strictly as a postlexical decision process (Perre & Ziegler, 2008). The link between orthography and phonology extends to novel words as well. In a recent study (Johnston et al., 2004), monolingual English speakers were taught a series of novel words but only learned the words’ phonological forms, and were never presented with orthography. During a sub- sequent masked priming task, orthographic versions of the trained words showed a significant priming effect, compared to the absence of any effect for completely novel written non- words. This finding suggests that learners automatically gen- erate orthographic forms for novel auditory words, based on the phonotactics of their native language. When these gener- ated forms are accurate, they can accelerate vocabulary learn- ing and improve reading of previously learned auditory words (McKague, Pratt, & Johnston, 2001). During second language learning, though, they are more likely to be inaccurate and impair learning. For example, an English-speaking learner of German may hear the auditory German word /vEk/ (spelled ‘weg’) and create an incorrect orthographic representation ‘veck’ based on their knowledge of English. This incorrect representation may then impair learning to read and write in German, as the learner’s internal representations must be in- hibited and relearned. Previous work indicates that English speakers are able to learn words and letter-sound mappings in artificial languages with training, even when they include

[1]  P. Bertelson,et al.  Does awareness of speech as a sequence of phones arise spontaneously? , 1979, Cognition.

[2]  A Karni,et al.  Alphabetical knowledge from whole words training: effects of explicit instruction and implicit experience on learning script segmentation. , 2003, Brain research. Cognitive brain research.

[3]  Michael K Tanenhaus,et al.  Tracking the time course of orthographic information in spoken-word recognition. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[4]  Margarita Kaushanskaya,et al.  Mapping Phonological Information from Auditory to Written Modality during Foreign Vocabulary Learning , 2008, Annals of the New York Academy of Sciences.

[5]  Margarita Kaushanskaya,et al.  The bilingual advantage in novel word learning , 2009, Psychonomic bulletin & review.

[6]  Janet G. van Hell,et al.  Keyword Mnemonics Versus Rote Rehearsal: Learning Concrete and Abstract Foreign Words by Experienced and Inexperienced Learners , 1997 .

[7]  Margarita Kaushanskaya,et al.  Bilingualism reduces native-language interference during novel-word learning. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Johannes C. Ziegler,et al.  On-line activation of orthography in spoken word recognition , 2008, Brain Research.

[9]  Jasone Cenoz,et al.  Additive trilingualism: Evidence from the Basque Country , 1994, Applied Psycholinguistics.

[10]  P. Viviani Eye movements in visual search: cognitive, perceptual and motor control aspects. , 1990, Reviews of oculomotor research.

[11]  Pierre A. Hallé,et al.  Where Is the /b/ in “absurde” [apsyrd]? It Is in French Listeners' Minds , 2000 .

[12]  C. Davis N-Watch: A program for deriving neighborhood size and other psycholinguistic statistics , 2005, Behavior research methods.

[13]  Chris Pratt,et al.  Evidence for an automatic orthographic code in the processing of visually novel word forms , 2004 .

[14]  Chris Pratt,et al.  The effect of oral vocabulary on reading visually novel words: a comparison of the dual-route-cascaded and triangle frameworks , 2001, Cognition.

[15]  Cristina Sanz,et al.  Bilingual education enhances third language acquisition: Evidence from Catalonia , 2000, Applied Psycholinguistics.

[16]  Ronald A. Cole,et al.  Sound and spelling in spoken word recognition. , 1985 .

[17]  K. de Bot Cognitive processing in bilinguals: From static to dynamic models , 2010 .

[18]  William J. Comer,et al.  Letter-Sound Correspondence Acquisition in First Semester Russian , 2004 .

[19]  Kara D. Federmeier,et al.  Timed picture naming in seven languages , 2003, Psychonomic bulletin & review.

[20]  Jasone Cenoz,et al.  The additive effect of bilingualism on third language acquisition: A review , 2003 .

[21]  Marc Brys,et al.  Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English , 2009 .

[22]  James Bartolotti,et al.  Language Learning and Control in Monolinguals and Bilinguals , 2012, Cogn. Sci..

[23]  Margarita Kaushanskaya,et al.  The Language Experience and Proficiency Questionnaire (LEAP-Q): assessing language profiles in bilinguals and multilinguals. , 2007, Journal of speech, language, and hearing research : JSLHR.

[24]  Max Coltheart,et al.  The MRC Psycholinguistic Database , 1981 .

[25]  R. Harris Cognitive processing in bilinguals , 1992 .