Markedness Effects in Visual Processing of Nonnative Onset Clusters

A variety of experimental methods have provided evidence for knowledge of constraints on wordforms, including sensitivity to markedness distinctions among different types of unattested sequences. For example, in acceptability judgment tasks with both auditory and visual stimuli the rating (or binary judgment) of a form generally decreases with markedness (auditory stimuli: Scholes, 1966; Coleman & Pierrehumbert, 1997; Frisch, Large & Pisoni, 2000; Albright, 2009 [based on Albright & Hayes, 2003]; Kager & Pater, 2012; Hayes & White, 2015; visual stimuli: Bailey & Hahn, 2001; Daland et al., 2011). Many of the relevant studies have focused on markedness relations among onset clusters, for example the graded distinctions of well-formedness due to sonority sequencing (e.g., sonority fall < sonority plateau < small sonority rise < large sonority rise). Unsurprisingly, novel words beginning with onset clusters that are attested in the native language of the participants (e.g., brif) receive higher ratings and endorsement rates than otherwise matched nonwords beginning with unattested clusters (e.g., rbif). More interesting is the fact that judgments distinguish among unattested clusters in a way that reflects degrees of markedness. For example, nonwords beginning with a smallrise onset (e.g., bnif) tend to be judged as superior to nonwords beginning with falling-sonority onsets (e.g., rbif), even by speakers of languages in which neither onset type occurs in lexical forms. Previous studies using auditory stimuli have also found sensitivity to markedness distinctions in online processing. More specifically, there is evidence from many perception and production tasks that nonnative clusters undergo the repair of perceptual epenthesis—the insertion of a reduced vowel that is not presented in the target form—in a way that reflects sonority-based and other markedness constraints (speech production: Davidson, 2006; Haunz, 2007; Wilson et al., 2014; speech perception: Dupoux et al, 1999; Berent et al., 2007; Maïonchi-Pino et al., 2014; Daland et al., submitted). For example, the results of syllable counting tasks essentially mirror those of acceptability judgment: monosyllabic nonwords beginning with more marked clusters are more likely to be identified as disyllabic, plausibly reflecting differences in the rate of perceptual epenthesis (e.g., epenthesis into a sonority plateau [bdif] ➝ [bәdif] applying more frequently than epenthesis into a small sonority rise [bnif] ➝ [bәnif]). While perceptual epenthesis is robustly attested for auditory stimuli, only a small number of studies have reported parallel effects for visually-presented forms (Berent, 2008; Berent & Lennertz, 2010). If the same or similar repair process applies regardless of the modality in which stimuli are presented, this would support a more abstract phonological locus of perceptual epenthesis. On the other hand, failure to find evidence of this repair in visual processing would be consistent with other results indicating that high rates of perceptual epenthesis depend on the presence of particular acoustic cues such as stop releases (e.g., Davidson 2010; Wilson et al., 2014; Lennertz & Berent, 2015; Zhao & Berent, 2015; Daland et al., submitted). In the present paper, we provide new evidence relevant to the question of whether marked onsets are repaired consistently across the auditory and visual modalities. Replicating the results of Berent & Lerentz (2010), we establish that some degree of sensitivity to sonority sequencing constraints can be

[1]  Frank Tong,et al.  Expertise for upright faces improves the precision but not the capacity of visual working memory , 2014, Attention, perception & psychophysics.

[2]  I. Berent,et al.  On the sonority levels of fricatives and stops , 2015 .

[3]  C. Sims Rate–distortion theory and human perception , 2016, Cognition.

[4]  I. Berent,et al.  Universal Restrictions on Syllable Structure: Evidence From Mandarin Chinese , 2015, Journal of Psycholinguistic Research.

[5]  D. Steriade,et al.  What we know about what we have never heard: Evidence from perceptual illusions , 2007, Cognition.

[6]  Bruce Hayes,et al.  Saltation and the P-map* , 2015, Phonology.

[7]  R W Proctor,et al.  An examination of response bias in multiletter matching , 1984, Perception & psychophysics.

[8]  I. Berent Are phonological representations of printed and spoken language isomorphic? Evidence from the restrictions on unattested onsets. , 2008, Journal of experimental psychology. Human perception and performance.

[9]  Roger Ratcliff,et al.  A Theory of Order Relations in Perceptual Matching , 2005 .

[10]  Colin Wilson,et al.  Effects of acoustic–phonetic detail on cross-language speech production , 2014 .

[11]  Lisa Davidson,et al.  Phonology, phonetics, or frequency: Influences on the production of non-native sequences , 2006, J. Phonetics.

[12]  Todd M. Bailey,et al.  Determinants of wordlikeness: Phonotactics or lexical neighborhoods? , 2001 .

[13]  Michael McCloskey,et al.  Both-edges representation of letter position in reading , 2011, Psychonomic bulletin & review.

[14]  Lisa Davidson,et al.  Phonetic bases of similarities in cross-language production: Evidence from English and Catalan , 2010, J. Phonetics.

[15]  Isabel Gauthier,et al.  A visual short-term memory advantage for objects of expertise. , 2009, Journal of experimental psychology. Human perception and performance.

[16]  N. Maïonchi‐Pino,et al.  Is syllable segmentation developmentally constrained by consonant sonority within syllable boundaries in silent reading? Evidence in French children , 2015 .

[17]  R. Kager,et al.  Phonotactics as phonology: knowledge of a complex restriction in Dutch* , 2012, Phonology.

[18]  J. Mehler,et al.  Epenthetic vowels in Japanese: A perceptual illusion? , 1999, Journal of Experimental Psychology: Human Perception and Performance.

[19]  Matthew Goldrick,et al.  Optimization and Quantization in Gradient Symbol Systems: A Framework for Integrating the Continuous and the Discrete in Cognition , 2014, Cogn. Sci..

[20]  R. Ratcliff A theory of order relations in perceptual matching. , 1981 .

[21]  Bruce Hayes,et al.  Explaining sonority projection effects* , 2011, Phonology.

[22]  I. Berent,et al.  Universal constraints on the sound structure of language: phonological or acoustic? , 2010, Journal of experimental psychology. Human perception and performance.

[23]  Christine Haunz Factors in on-line loanword adaptation , 2007 .

[24]  Adam Albright,et al.  Feature-based generalisation as a source of gradient acceptability* , 2009, Phonology.

[25]  Drew H. Abney,et al.  Journal of Experimental Psychology : Human Perception and Performance Influence of Musical Groove on Postural Sway , 2015 .

[26]  John Coleman,et al.  Stochastic phonological grammars and acceptability , 1997, SIGMORPHON@EACL.

[27]  David B Pisoni,et al.  Perception of Wordlikeness: Effects of Segment Probability and Length on the Processing of Nonwords. , 2000, Journal of memory and language.

[28]  S. Peperkamp,et al.  The role of speech production in phonological decoding during visual word recognition: evidence from phonotactic repair , 2016 .