Auditory-Visual Perception of VCVs Produced by People with Down Syndrome: Preliminary Results

Down Syndrome (DS) is a genetic disease involving a number of anatomical, physiological and cognitive impairments. More particularly it affects speech production abilities. This results in reduced intelligibility which has however only been evaluated auditorily. Yet, many studies have demonstrated that adding vision to audition helps perception of speech produced by people without impairments especially when it is degraded as is the case in noise. The present study aims at examining whether the visual information improves intelligibility of people with DS. 24 participants without DS were presented with VCV sequences (vowel-consonant-vowel) produced by four adults (2 with DS and 2 without DS). These stimuli were presented in noise in three modalities: auditory, auditory-visual and visual. The results confirm a reduced auditory intelligibility of speakers with DS. They also show that, for the speakers involved in this study, visual intelligibility is equivalent to that of speakers without DS and compensates for the auditory intelligibility loss. An analysis of the perceptual errors shows that most of them involve confusions between consonants. These results put forward the crucial role of multimodality in the improvement of the intelligibility of people with DS.

[1]  Kate Bunton,et al.  Influence of visual information on the intelligibility of dysarthric speech. , 2007, American journal of speech-language pathology.

[2]  R. H. Stetson,et al.  Speech Through the Ear, the Eye, the Mouth and the Hand , 2009 .

[3]  E. Lazcano-Ponce,et al.  Intellectual disability: definition, etiological factors, classification, diagnosis, treatment and prognosis. , 2008, Salud publica de Mexico.

[4]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[5]  Q Summerfield,et al.  Use of Visual Information for Phonetic Perception , 1979, Phonetica.

[6]  Amélie Rochet-Capellan,et al.  Acoustic characterisation of vowel production by young adults with Down syndrome , 2015, ICPhS.

[7]  Bruno Estigarribia,et al.  Language Characteristics of Individuals With Down Syndrome , 2009, Topics in language disorders.

[8]  K. Hustad,et al.  Effects of presentation mode and repeated familiarization on intelligibility of dysarthric speech. , 2003, American journal of speech-language pathology.

[9]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[10]  P F Seitz,et al.  The use of visible speech cues for improving auditory detection of spoken sentences. , 2000, The Journal of the Acoustical Society of America.

[11]  Libby Kumin,et al.  Speech intelligibility and childhood verbal apraxia in children with Down syndrome. , 2006, Down's syndrome, research and practice : the journal of the Sarah Duffen Centre.

[12]  K. Hustad The relationship between listener comprehension and intelligibility scores for speakers with dysarthria. , 2008, Journal of speech, language, and hearing research : JSLHR.

[13]  Q. Summerfield Some preliminaries to a comprehensive account of audio-visual speech perception. , 1987 .

[14]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[15]  Raymond D. Kent,et al.  Speech impairment in Down syndrome: a review. , 2013, Journal of speech, language, and hearing research : JSLHR.