Auditory-visual perception of acoustically degraded prosodic contrastive focus in French

Previous studies have shown that visual only perception of prosodic contrastive focus in French is possible. The aim of this study was to determine whether the visual modality could be combined to the auditory one and lead to a perceptual enhancement of prosodic focus. In order to examine this question, we carried out auditory only, audiovisual and visual only perception tests. In order to avoid a ceiling effect, auditory only perception of prosodic focus being very high, we used whispered speech for which the acoustic prosodic information is degraded. The productions of two different speakers were used. This test showed that adding the visual modality enhances auditory perception of prosodic focus when the acoustic prosodic cues are degraded.

[1]  Louis D. Braida,et al.  Evaluating the articulation index for auditory-visual input. , 1987, The Journal of the Acoustical Society of America.

[2]  Q Summerfield,et al.  Use of Visual Information for Phonetic Perception , 1979, Phonetica.

[3]  Mohamed Tahar Lallouache,et al.  Un poste "visage-parole" couleur : acquisition et traitement automatique des contours des lèvres , 1991 .

[4]  G. A. Miller,et al.  Erratum: An Analysis of Perceptual Confusions Among Some English Consonants [J. Acoust. Soc. Am. 27, 339 (1955)] , 1955 .

[5]  M. Swerts,et al.  Congruent and incongruent audiovisual cues to prominence , 2004, Speech Prosody 2004.

[6]  N. P. Erber Auditory-visual perception of speech. , 1975, The Journal of speech and hearing disorders.

[7]  A. Macleod,et al.  Quantifying the contribution of vision to speech perception in noise. , 1987, British journal of audiology.

[8]  K. K. Neely Effect of Visual Factors on the Intelligibility of Speech , 1956 .

[9]  Emiel Krahmer,et al.  Cognitive processing of audiovisual cues to prominence , 2005, AVSP.

[10]  Hélène Loevenbruck Pistes pour le contrôle d'un robot parlant capable de réduction vocalique , 1996 .

[11]  Marion Dohen,et al.  Audiovisual production and perception of contrastive focus in French: a multispeaker study , 2005, INTERSPEECH.

[12]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[13]  A A Montgomery,et al.  Auditory and visual contributions to the perception of consonants. , 1974, Journal of speech and hearing research.

[14]  C. Benoît,et al.  Effects of phonetic context on audio-visual intelligibility of French. , 1994, Journal of speech and hearing research.

[15]  David Taylor Hearing by Eye: The Psychology of Lip-Reading , 1988 .

[16]  D. Dahan,et al.  Interspeaker Variability in Emphatic Accent Production in French , 1996, Language and speech.