A Multi-Componential Approach to Emotion Recognition and the Effect of Personality

Emotions are an inseparable part of human nature affecting our behavior in response to the outside world. Although most empirical studies have been dominated by two theoretical models including discrete categories of emotion and dichotomous dimensions, results from neuroscience approaches suggest a multi-processes mechanism underpinning emotional experience with a large overlap across different emotions. While these findings are consistent with the influential theories of emotion in psychology that emphasize a role for multiple component processes to generate emotion episodes, few studies have systematically investigated the relationship between discrete emotions and a full componential view. This paper applies a componential framework with a data-driven approach to characterize emotional experiences evoked during movie watching. The results suggest that differences between various emotions can be captured by a few (at least 6) latent dimensions, each defined by features associated with component processes, including appraisal, expression, physiology, motivation, and feeling. In addition, the link between discrete emotions and component model is explored and results show that a componential model with a limited number of descriptors is still able to predict the level of experienced discrete emotion(s) to a satisfactory level. Finally, as appraisals may vary according to individual dispositions and biases, we also study the relationship between personality traits and emotions in our computational framework and show that the role of personality on discrete emotion differences can be better justified using the component model.

[1]  J. Stainer,et al.  The Emotions , 1922, Nature.

[2]  P. Costa,et al.  Influence of extraversion and neuroticism on subjective well-being: happy and unhappy people. , 1980, Journal of personality and social psychology.

[3]  Craig A. Smith,et al.  The structure of self-reports of emotional responses to film segments , 1982 .

[4]  Edward McAuley,et al.  Causal attributions, causal dimensions, and affective reactions to success and failure , 1986 .

[5]  K. Mcgraw,et al.  Guilt following transgression: an attribution of responsibility approach. , 1987, Journal of personality and social psychology.

[6]  B. Weiner,et al.  Testing some attribution-emotion relations in the People's Republic of China. , 1989, Journal of personality and social psychology.

[7]  N. Frijda,et al.  Relations among emotion, appraisal, and emotional action readiness , 1989 .

[8]  G. Stenberg,et al.  Personality and the EEG: Arousal and emotional arousability , 1992 .

[9]  P. Ekman An argument for basic emotions , 1992 .

[10]  C. Izard,et al.  Stability of emotion experiences and their relations to traits of personality. , 1993, Journal of personality and social psychology.

[11]  Rainer Reisenzein,et al.  Subjectively salient dimensions of emotional appraisal , 1994 .

[12]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[13]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[14]  L. R. Goldberg,et al.  The language of personality: Lexical perspectives on the five-factor model. , 1996 .

[15]  N. Kuiper,et al.  Individual differences in the experience of emotions. , 1997, Clinical psychology review.

[16]  Klaus R. Scherer,et al.  Lost Luggage: A Field Study of Emotion–Antecedent Appraisal , 1997 .

[17]  H. Cooper,et al.  The happy personality: a meta-analysis of 137 personality traits and subjective well-being. , 1998, Psychological bulletin.

[18]  Craig A. Smith,et al.  Contributions of Motivational Orientation to Appraisal and Emotion , 2000 .

[19]  杨文秀,et al.  此处“personality”译法探析 , 2000 .

[20]  Richard E. Lucas,et al.  Factors influencing the relation between extraversion and pleasant affect. , 2000, Journal of personality and social psychology.

[21]  R. Lazarus Relational meaning and discrete emotions. , 2001 .

[22]  Frédéric F. Brunel,et al.  Linking thoughts to feelings: Investigating cognitive appraisals and consumption emotions in a mixed-emotions context , 2002 .

[23]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[24]  P. Ekman Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life , 2003 .

[25]  Peter Kuppens,et al.  The appraisal basis of anger: specificity, necessity and sufficiency of components. , 2003, Emotion.

[26]  J. Russell Core affect and the psychological construction of emotion. , 2003, Psychological review.

[27]  E. Phelps Human emotion and memory: interactions of the amygdala and hippocampal complex , 2004, Current Opinion in Neurobiology.

[28]  V. Pascalis,et al.  Personality, event-related potential (ERP) and heart rate (HR) in emotional word processing ☆ , 2004 .

[29]  Howard Tennen,et al.  Dynamic approaches to emotions and stress in everyday life: Bolger and Zuckerman reloaded with positive as well as negative affects. , 2005, Journal of personality.

[30]  David Sander,et al.  A systems approach to appraisal mechanisms in emotion , 2005, Neural Networks.

[31]  M. Carrasco,et al.  PSYCHOLOGICAL SCIENCE Research Article Emotion Facilitates Perception and Potentiates the Perceptual Benefits of Attention , 2022 .

[32]  Paul A Pilkonis,et al.  Neuroticism and affective instability: the same or different? , 2006, The American journal of psychiatry.

[33]  George D. Bishop,et al.  The role of the Big Five in appraisals , 2006 .

[34]  O. John,et al.  Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German , 2007 .

[35]  James J Gross,et al.  Same situation--different emotions: how appraisals shape our emotions. , 2007, Emotion.

[36]  K. Scherer,et al.  The World of Emotions is not Two-Dimensional , 2007, Psychological science.

[37]  I. van Mechelen,et al.  Individual differences in core affect variability and their relationship to personality and psychological adjustment. , 2007, Emotion.

[38]  Daniel S. Levine,et al.  How Does the Brain Create, Change, and Selectively Override its Rules of Conduct? , 2007 .

[39]  Mohammad Soleymani,et al.  Affective ranking of movie scenes using physiological signals and content analysis , 2008, MS '08.

[40]  Piers Steel,et al.  Refining the relationship between personality and subjective well-being. , 2008, Psychological bulletin.

[41]  Andrea Esuli,et al.  Evaluation Measures for Ordinal Regression , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[42]  Klaus R Scherer,et al.  Emotions are emergent processes: they require a dynamic computational architecture , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[44]  Weiting Ng,et al.  Clarifying the relation between neuroticism and positive emotions , 2009 .

[45]  K. Scherer The dynamic architecture of emotion: Evidence for the component process model , 2009 .

[46]  A. Schaefer,et al.  Please Scroll down for Article Cognition & Emotion Assessing the Effectiveness of a Large Database of Emotion-eliciting Films: a New Tool for Emotion Researchers , 2022 .

[47]  P. Ekman,et al.  What is Meant by Calling Emotions Basic , 2011 .

[48]  Elizabeth G. Kehoe,et al.  Personality modulates the effects of emotional arousal and valence on brain activation. , 2012, Social cognitive and affective neuroscience.

[49]  Shashidhar G. Koolagudi,et al.  Emotion recognition from speech: a review , 2012, International Journal of Speech Technology.

[50]  Klaus R. Scherer,et al.  Advocating a Componential Appraisal Model to Guide Emotion Recognition , 2012, Int. J. Synth. Emot..

[51]  Klaus R. Scherer,et al.  Nonlinear Appraisal Modeling: An Application of Machine Learning to the Study of Emotion Production , 2013, IEEE Transactions on Affective Computing.

[52]  Ravi Kothuri,et al.  Physiological Correlates of the Big 5: Autonomic Responses to Video Presentations , 2013, Applied psychophysiology and biofeedback.

[53]  Talma Hendler,et al.  E-motion pictures of the brain: Recursive paths between affective neuroscience and film studies. , 2013 .

[54]  Chung-Hsien Wu,et al.  Survey on audiovisual emotion recognition: databases, features, and data fusion strategies , 2014, APSIPA Transactions on Signal and Information Processing.

[55]  Fionn Murtagh,et al.  Ward’s Hierarchical Agglomerative Clustering Method: Which Algorithms Implement Ward’s Criterion? , 2011, Journal of Classification.

[56]  Jari Lipsanen,et al.  The Effect of Personality on Daily Life Emotional Processes , 2014, PloS one.

[57]  R. Littlewood Components of Emotional Meaning: A Sourcebook , 2014, British Journal of Psychiatry.

[58]  Björn Schuller,et al.  Emotion Recognition in Naturalistic Speech and Language—A Survey , 2015 .

[59]  Marcello Mortillaro,et al.  Emotions: Methods of Assessment , 2015 .

[60]  Amit Konar,et al.  Emotion Recognition: A Pattern Analysis Approach , 2015 .

[61]  Charles A. Sanislow,et al.  Ratings for emotion film clips , 2015, Behavior research methods.

[62]  Sylvia D. Kreibig,et al.  Eliciting positive, negative and mixed emotional states: A film library for affective scientists , 2016, Cognition & emotion.

[63]  Pedro Antonio Gutiérrez,et al.  Ordinal Regression Methods: Survey and Experimental Study , 2016, IEEE Transactions on Knowledge and Data Engineering.

[64]  L. Davachi,et al.  Emotional brain states carry over and enhance future memory formation , 2016, Nature Neuroscience.

[65]  Gelareh Mohammadi,et al.  Towards Understanding Emotional Experience in a Componential Framework , 2019, 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII).

[66]  David Rudrauf,et al.  Induction and Profiling of Strong Multi-Componential Emotions in Virtual Reality , 2018, IEEE Transactions on Affective Computing.