Auditory and audiovisual close-shadowing in normal and cochlear-implanted hearing impaired subjects

This study takes place in the theoretical background of perceptuo-motor linkage in speech perception. A close-shadowing experiment has been carried out on post-lingual cochlear implanted (CI) and normal-hearing (NH) adults in order to evaluate sensory-motor interactions during joint perception and production of speech. To this aim, participants have to categorize audio (A) and audiovisual (AV) syllables as quickly as possible, with two modes of responses, oral or manual. Overall, responses from NH were globally faster and more precise than those of CI, although adding the visual modality led to a gain in performance in CI. Critically, oral responses were faster but less precise than manual responses in the two groups, with a stronger difference observed for CI than for NH. Despite auditory deprivation, these results suggest the involvement of sensory-motor interactions during speech perception in CI, albeit possibly less efficient than in NH.

[1]  M. Turvey,et al.  The motor theory of speech perception reviewed , 2006, Psychonomic bulletin & review.

[2]  Jean-Luc Schwartz,et al.  The Perception-for-Action-Control Theory , 2005 .

[3]  Pascal Perrier,et al.  A theory of speech motor control and supporting data from speakers with normal hearing and with profound hearing loss , 2000, J. Phonetics.

[4]  F. X. Castellanos,et al.  Speech-production measures of speech perception: rapid shadowing of VCV syllables. , 1980, The Journal of the Acoustical Society of America.

[5]  H Lane,et al.  Speech of cochlear implant patients: a longitudinal study of vowel production. , 1992, The Journal of the Acoustical Society of America.

[6]  C. Fowler,et al.  Rapid access to speech gestures in perception: Evidence from choice and simple response time tasks. , 2003, Journal of memory and language.

[7]  Jean-Luc Schwartz,et al.  The shadow of a doubt? Evidence for perceptuo-motor linkage during auditory and audiovisual close-shadowing , 2014, Front. Psychol..

[8]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[9]  H. Lane,et al.  Speech deterioration in postlingually deafened adults. , 1991, The Journal of the Acoustical Society of America.

[10]  Lucie Ménard,et al.  Interactions of speaking condition and auditory feedback on vowel production in postlingually deaf adults with cochlear implants. , 2007, The Journal of the Acoustical Society of America.

[11]  P. Barone,et al.  Evolution of crossmodal reorganization of the voice area in cochlear‐implanted deaf patients , 2012, Human brain mapping.

[12]  Jeremy I. Skipper,et al.  Seeing Voices : How Cortical Areas Supporting Speech Production Mediate Audiovisual Speech Perception , 2007 .