Vocal cues in emotion encoding and decoding

This research examines the correspondence between theoretical predictions on vocal expression patterns in naturally occurring emotions (as based on the component process theory of emotion; Scherer, 1986) and empirical data on the acoustic characteristics of actors' portrayals. Two male and two female professional radio actors portrayed anger, sadness, joy, fear, and disgust based on realistic scenarios of emotion-eliciting events. A series of judgment studies was conducted to assess the degree to which judges are able to recognize the intended emotion expressions. Disgust was relatively poorly recognized; average recognition accuracy for the other emotions attained 62.8% across studies. A set of portrayals reaching a satisfactory level of recognition accuracy underwent digital acoustic analysis. The results for the acoustic parameters extracted from the speech signal show a number of significant differences between emotions, generally confirming the theoretical predictions.

[1]  G. Fairbanks,et al.  An experimental study of the pitch characteristics of the voice during the expression of emotion , 1939 .

[2]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[3]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[4]  The emotions and the ergotropic and trophotropic systems , 1970 .

[5]  K. Stevens,et al.  Emotions and speech: some acoustical correlates. , 1972, The Journal of the Acoustical Society of America.

[6]  J. Fleiss.  Statistical methods for rates and proportions , 1974 .

[7]  K. Scherer.  Nonlinguistic Vocal Indicators of Emotion and Psychopathology , 1979 .

[8]  M. Zuckerman.  Verbal and nonverbal communication of deception , 1981 .

[9]  Francis Nolan,et al.  The Phonetic Bases of Speaker Recognition , 1983 .

[10]  Judith A. Hall.  Nonverbal sex differences : communication accuracy and expressive style , 1984 .

[11]  Kim E. A. Silverman,et al.  Vocal cues to speaker affect: testing two models , 1984 .

[12]  K. Scherer,et al.  How universal and specific is emotional experience? Evidence from 27 countries on five continents , 1986 .

[13]  K. Scherer,et al.  Cues and channels in emotion recognition. , 1986 .

[14]  K. Scherer,et al.  Experiencing emotion : a cross-cultural study , 1986 .

[15]  K. Scherer.  Vocal affect expression: a review and a model for future research. , 1986, Psychological bulletin.

[16]  S. Feldstein,et al.  The Telltale Voice: Nonverbal Messages of Verbal Communication , 1987 .

[17]  A. Fallon,et al.  A perspective on disgust. , 1987, Psychological review.

[18]  H. Wallbott,et al.  Big girls don't frown, big boys don't cry—Gender differences of professional actors in communicating emotion via facial expression , 1988 .

[19]  P. Ekman,et al.  Smiles when lying. , 1988, Journal of personality and social psychology.

[20]  D. Rubin,et al.  Effect Size Estimation for One-Sample Multiple-Choice-Type Data: Design, Analysis, and Meta-Analysis , 1989 .

[21]  H. Wagner.  The spontaneous facial expression of differential positive and negative emotions , 1990 .