THE CONTRIBUTION OF KINESIC ILLUSTRATORS TOWARD THE COMPREHENSION OF VERBAL BEHAVIOR WITHIN UTTERANCES

The study assessed the extent to which a speaker's visible body movements can improve verbal comprehension for listeners. Subjects responded to multiple-choice items designed to test their comprehension of 12 videotaped spoken utterances which had been obtained by asking speakers to describe either objects in motion (e.g., a tennis ball, a car, spraying water) or abstract concepts. The 60 subjects each responded to stimuli in one of three presentation conditions (audiovisual, audiovisual without lip and facial cues, and audio-alone) over four signal-to-noise ratios. The results indicated that: (1) visual cues can at times significantly improve comprehension scores, even with lip and facial cues not present; (2) visual cues are increasingly useful as noise is introduced; (3) visual cues assist the comprehension of certain grammatical types of verbal segments regardless of semantic content expressed in those type segments.

[1]  W. Stokoe SIGN LANGUAGE AUTONOMY * , 1976, Annals of the New York Academy of Sciences.

[2]  S. Harnad,et al.  FROM HAND TO MOUTH: SOME CRITICAL STAGES IN THE EVOLUTION OF LANGUAGE , 1976, Annals of the New York Academy of Sciences.

[3]  D. Kimura,et al.  Motor functions of the left hemisphere. , 1974, Brain : a journal of neurology.

[4]  J. C. Baxter,et al.  Gestural behavior during a brief interview as a function of cognitive variables. , 1968, Journal of personality and social psychology.

[5]  J. P. Foley,et al.  Gesture and Environment , 1942 .

[6]  Akiba A. Cohen,et al.  The Communicative Functions of Hand I1lustrators , 1977 .

[7]  A. Chapanis Prelude to 2001: Explorations in Human Communication. , 1971 .

[8]  William S. Condon,et al.  Method of micro-analysis of sound films of behavior , 1970 .

[9]  N. Freedman,et al.  Body Movement and Verbal Encoding in the Congenitally Blind , 1974, Perceptual and motor skills.

[10]  G. Hewes THE CURRENT STATUS OF THE GESTURAL THEORY OF LANGUAGE ORIGIN , 1976 .

[11]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[12]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[13]  Allen T. Dittmann,et al.  Chapter 7 – The Body Movement-Speech Rhythm Relationship as a Cue to Speech Encoding , 1972 .

[14]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[15]  E. Renzi,et al.  Ideational apraxia: A quantitative study , 1968 .

[16]  A. Kendon Some Relationships Between Body Motion and Speech , 1972 .

[17]  M. Woodward,et al.  Phoneme perception in lipreading. , 1960, Journal of speech and hearing research.

[18]  R. Birdwhistell Kinesics and context , 1970 .