Language and Gender Effect in Decoding Emotional Information: A Study on Lithuanian Subjects

The present work explores how language specificity and gender affect the emotional decoding process. It investigates the ability of Lithuanian male and female subjects to decode emotional information through male and female vocal and visual emotional expressions. The exploited emotional stimuli are based on extracts of American English (a globally spread language), and Italian (a country specific language) movies. The assumption is that the recognition of the emotional states expressed by the actors/actresses will change according to the familiarity of the languages and the subjects’ gender. Results show that Lithuanian subjects recognition accuracy is affected by the language specificity of the stimuli. Moreover, a gender effect occurs in decoding Italian vocal stimuli.

[1]  Anna Esposito,et al.  A Cross-Cultural Study on the Effectiveness of Visual and Vocal Channels in Transmitting Dynamic Emotional Information , 2012 .

[2]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[3]  Klaus R. Scherer,et al.  Vocal communication of emotion: A review of research paradigms , 2003, Speech Commun..

[4]  K. Scherer,et al.  Culture and emotion. , 1997 .

[5]  Anna Esposito,et al.  The Perceptual and Cognitive Role of Visual and Auditory Channels in Conveying Emotional Information , 2009, Cognitive Computation.

[6]  C. Izard.  Innate and universal facial expressions: evidence from developmental and cross-cultural research. , 1994, Psychological bulletin.

[7]  P. Ekman.  An argument for basic emotions , 1992 .

[8]  Klaus Miesenberger,et al.  HCI and Usability for e-Inclusion, 5th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2009, Linz, Austria, November 9-10, 2009 Proceedings , 2009, USAB.

[9]  D. Keltner,et al.  The Gender Stereotyping of Emotions , 2000 .

[10]  Anna Esposito,et al.  On the Perception of Emotional "Voices": A Cross-Cultural Comparison among American, French and Italian Subjects , 2010, COST 2102 Conference.

[11]  D. Crystal,et al.  English as a Global Language , 1998 .

[12]  Anna Esposito,et al.  The Amount of Information on Emotional States Conveyed by the Verbal and Nonverbal Channels: Some Perceptual Data , 2005, WNSP.

[13]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  K. Scherer,et al.  Emotion Inferences from Vocal Expression Correlate Across Languages and Cultures , 2001 .

[15]  Walid Karam,et al.  Multimodal Human Machine Interactions in Virtual and Augmented Reality , 2009, COST 2102 School.

[16]  Véronique Aubergé,et al.  Can we hear the prosody of smile? , 2003, Speech Commun..

[17]  Meng Wang,et al.  Movie2Comics: Towards a Lively Video Content Presentation , 2012, IEEE Transactions on Multimedia.

[18]  Nikolaos G. Bourbakis,et al.  Cultural Specific Effects on the Recognition of Basic Emotions: A Study on Italian Subjects , 2009, USAB.

[19]  Yannis Stylianou,et al.  Progress in Nonlinear Speech Processing, Workshop on Nonlinear Speech Processing, WNSP 2005, Heraklion, Crete, Greece, September 20-23, 2005 , 2007, WNSP.

[20]  L. F. Barrett,et al.  Handbook of Emotions , 1993 .

[21]  J. Russell,et al.  The psychology of facial expression: Frontmatter , 1997 .

[22]  D. Crystal.  English as a global language: Contents , 2003 .

[23]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[24]  I. Poggi,et al.  Multimodal markers of irony and sarcasm , 2003 .

[25]  J. Russell.  Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[26]  Технология.  Springer Science+Business Media , 2013 .

[27]  K. Scherer,et al.  Evidence for universality and cultural variation of differential emotion response patterning. , 1994, Journal of personality and social psychology.

[28]  A. J. Fridlund.  The psychology of facial expression: The new ethology of human facial expressions , 1997 .

[29]  Ling Guan,et al.  Kernel Cross-Modal Factor Analysis for Information Fusion With Application to Bimodal Emotion Recognition , 2012, IEEE Transactions on Multimedia.

[30]  Judith A. Hall,et al.  Gender and emotion in context. , 2008 .

[31]  Anna Esposito,et al.  Multimodal Signals: Cognitive and Algorithmic Issues, COST Action 2102 and euCognition International School Vietri sul Mare, Italy, April 21-26, 2008, Revised Selected and Invited Papers , 2009, COST 2102 School.

[32]  Constantine Kotropoulos,et al.  Emotional speech recognition: Resources, features, and methods , 2006, Speech Commun..

[33]  F. Mast,et al.  Gender Effects in Information Processing on a Nonverbal Decoding Task , 2011 .