Voice-to-Affect Mapping: Inferences on Language Voice Baseline Settings

Modulations of the voice convey affect, and the precise mapping of voice-to-affect may vary for different languages. However, affect-related modulations occur relative to the baseline affect-neutral voice, which tends to differ from language to language. Little is known about the characteristic long-term voice settings for different languages, and how they influence the use of voice quality to signal affect. In this paper, data from a voice-to-affect perception test involving Russian, English, Spanish and Japanese subjects is reexamined to glean insights concerning likely baseline settings in these languages. The test used synthetic stimuli with different voice qualities (modelled on a male voice), with or without extreme f0 contours as might be associated with affect. Cross-language differences in affect ratings for modal and tense voice suggest that the baseline in Spanish and Japanese is inherently tenser than in Russian and English, and that as a corollary, tense voice serves as a more potent cue to high-activation affects in the latter languages. A relatively tenser baseline in Japanese and Spanish is further suggested by the fact that tense voice can be associated with intimate, a low activation state, just as readily as with the high-activation state interested.

[1]  Ailbhe Ní Chasaide,et al.  Universal and Language-specific Perception of Affect from Voice , 2011, ICPhS.

[2]  Ailbhe Ní Chasaide,et al.  The role of voice quality in communicating emotion, mood and attitude , 2003, Speech Commun..

[3]  K. Scherer Vocal affect expression: a review and a model for future research. , 1986, Psychological bulletin.

[4]  J. Stuart-Smith Glasgow: accent and voice quality , 1999 .

[5]  J. L. Mozziconacci PITCH VARIATIONS AND EMOTION IN SPEECH , 1995 .

[6]  D. Klatt,et al.  Analysis, synthesis, and perception of voice quality variations among female and male talkers. , 1990, The Journal of the Acoustical Society of America.

[7]  Mapping Voice to Affect: Japanese listeners , 2006 .

[8]  D. Crystal The English tone of voice: essays in intonation, prosody and paralanguage / David Crystal , 1975 .

[9]  P. Trudgill The Social Differentiation of English in Norwich , 1974 .

[10]  C. Gobl,et al.  Expressive synthesis: how crucial is voice quality? , 2002, Proceedings of 2002 IEEE Workshop on Speech Synthesis, 2002..

[11]  Ailbhe Ní Chasaide,et al.  Voice quality and f0 cues for affect expression: implications for synthesis , 2005, INTERSPEECH.

[12]  Ailbhe Ní Chasaide,et al.  Voice Source Variation and Its Communicative Functions , 2010 .

[13]  J. Laver The phonetic description of voice quality , 1980 .

[14]  Klaus R. Scherer,et al.  Vocal communication of emotion: A review of research paradigms , 2003, Speech Commun..