Impact of acoustic similarity on efficiency of verbal information transmission via subtle prosodic cues

In this study, we investigate the effect of tiny acoustic differences on the efficiency of prosodic information transmission. Study participants listened to textually ambiguous sentences, which could be understood with prosodic cues, such as syllable length and pause length. Sentences were uttered in voices similar to the participant’s own voice and in voices dissimilar to their own voice. The participants then identified which of four pictures the speaker was referring to. Both the eye movement and response time of the participants were recorded. Eye tracking and response time results both showed that participants understood the textually ambiguous sentences faster when listening to voices similar to their own. The results also suggest that tiny acoustic features, which do not contain verbal meaning can influence the processing of verbal information.

[1]  Dik J. Hermes,et al.  Measuring the perceptual similarity of pitch contours , 1995, EUROSPEECH.

[2]  Sang-Ki Lee.  EFFECTS OF TEXTUAL ENHANCEMENT AND TOPIC FAMILIARITY ON KOREAN EFL STUDENTS READING COMPREHENSION AND LEARNING OF PASSIVE FORM , 2007 .

[3]  Yuki Hirose.  Speaker's Intention and Hearer's Comprehension : A Latent Function of Lexical Accent in Syntax , 2006 .

[4]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[5]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[6]  T Landis,et al.  Role of bone conduction in the self-perception of speech. , 1990, Folia phoniatrica.

[7]  S. Scott,et al.  Comprehension of familiar and unfamiliar native accents under adverse listening conditions. , 2009, Journal of experimental psychology. Human perception and performance.

[8]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[9]  İsmail Hakkı Erten,et al.  The effects of cultural familiarity on reading comprehension , 2009 .

[10]  Ferenc Bunta,et al.  The Effects of Nonnative Accents on Listening Comprehension: Implications for ESL Assessment , 2002 .

[11]  Jason J S Barton,et al.  Information Processing during Face Recognition: The Effects of Familiarity, Inversion, and Morphing on Scanning Fixations , 2006, Perception.

[12]  Stefan R Schweinberger,et al.  Influences of fundamental frequency, formant frequencies, aperiodicity, and spectrum level on the perception of voice gender. , 2014, Journal of speech, language, and hearing research : JSLHR.

[13]  Kazuya Takeda,et al.  Relationship between speaker/listener similarity and information transmission quality in speech communication , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[14]  Hideki Kawahara,et al.  Voice aftereffects of adaptation to speaker identity , 2010, Hearing Research.

[15]  Michael J. Leeser.  Learner-based factors in L2 reading comprehension and processing grammatical form : Topic familiarity and working memory , 2007 .

[16]  Neil J. Anderson.  Exploring Second Language Reading: Issues and Strategies , 1999 .

[17]  T. Valentine,et al.  Why are average faces attractive? The effect of view and averageness on the attractiveness of female faces , 2004, Psychonomic bulletin & review.

[18]  Hideki Kawahara,et al.  Development of exploratory research tools based on TANDEM-STRAIGHT , 2009 .

[19]  Hideki Kawahara,et al.  Nearly defect-free F0 trajectory extraction for expressive speech modifications based on STRAIGHT , 2005, INTERSPEECH.

[20]  D. Slobin.  Grammatical transformations and sentence comprehension in childhood and adulthood , 1966 .

[21]  Hossein Nassaji,et al.  Schema Theory and Knowledge-Based Processes in Second Language Reading Comprehension: A Need for Alternative Perspectives , 2002 .