The McGurk Effect Is Influenced By The Stimulus Set Size

This study examined if the size of the McGurk effect depends on the size of stimulus set presented in a block. The auditory syllables used in the present experiment was dubbed with either a compatible visible syllable or a discrepant visible syllable about place of articu-lation, resulting in 16 audiovisual stimuli. In the small set condition, two auditory consonants, {/pa/ and /ta/ } in one case and {/ma/ and /na/} in another case, appeared in a block. In the medium set condition, fourpending on stimulus set-size. Participants identified consonant in three presentation conditions: audio-visual , audio-only, video-only. Except the video-only condition, auditory white noise was added (S/N=0dB). There was also a clear audiovisual condition in which no auditory noise was added. The results for bimodal discrepant pairs showed that auditory labials differ from auditory nonlabials with respect to the effect of the set size: although the auditory nonlabials (/ta/, / na/) did not show the effect of the set size, the size of the McGurk effect for auditory labials (/pa/, /ma/) depended on the stimulus set size, being larger when a consonant appeared in smaller sets. On the other hand, unimodal identifications were not affected by the set size. The observed effect of the set size on the McGurk effect was argued in terms of the number of dimensions in auditory and visual information.

[1]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[2]  Y. Tohkura,et al.  McGurk effect in non-English listeners: few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. , 1991, The Journal of the Acoustical Society of America.

[3]  B. Walden,et al.  Effects of training on the visual recognition of consonants. , 1977, Journal of speech and hearing research.

[4]  H. McGurk,et al.  Visual influences on speech perception processes , 1978, Perception & psychophysics.