Micro-expression Cognition and Emotion Modeling Based on Gross Reappraisal Strategy

Micro-expression cognition is a vital useful input to develop affective computing strategies in modern human-computer/robot interaction. In this paper, an effective system for micro-expression cognition and emotional regulation is described. As input, a micro-expressional face is represented as a point in a 3D space characterized by arousal, valence and stance factors. The capture and recognition method of micro-expressions is based on a novel combination of 3D-Gradient projection descriptor, multi-scale and multi-direction Gabor filter bank and the gradient magnitude weighted Nearest Neighbor Algorithm (NNA) in facial feature regions. The main distinguishing feature of our work is that the emotional regulation model does not simply provide the classification and jump in terms of a set of discrete emotional labels, but that it operates in a continuous 3D emotional space enabling a wide range of intermediary emotional states to be obtained. The micro-expression recognition method has been tested with the Yale University’s facial database and universal participants’ facial database so that it is capable of analyzing any adult subject, male or female in the typical database and interactive process. Then the cognition and emotion system has been applied to the human-robot interaction, and the results are very encouraging and show that our micro-expression cognition and emotion model is generally consistent with human brain emotional regulation mechanisms.

[1]  M. Bradley,et al.  Emotion, Motivation, and Anxiety: Brain Mechanisms and Psychophysiology the Motivational Organization of Emotion Patterns of Human Emotion Emotion and Perception the Psychophysiology of Picture Processing Neural Imaging: Motivation in the Visual Cortex Motivational Circuits in the Brain , 2022 .

[2]  Yuichi Ohta,et al.  Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor , 2009, ICDP.

[3]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[4]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[5]  John E. Laird,et al.  Toward a Comprehensive Computational Model of Emotions and Feelings , 2004, ICCM.

[6]  J. Panksepp.  Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[7]  Eva Cerezo,et al.  Facial emotional classification: from a discrete perspective to a continuous emotional space , 2013, Pattern Analysis and Applications.

[8]  Juan José del Coz,et al.  On the study of nearest neighbor algorithms for prevalence estimation in binary problems , 2013, Pattern Recognit..

[9]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[10]  Paolo Dario,et al.  On the development of the emotion expression humanoid robot WE-4RII with RCH-1 , 2004, 4th IEEE/RAS International Conference on Humanoid Robots, 2004..

[11]  Vladimir Risojevic,et al.  Fusion of Global and Local Descriptors for Remote Sensing Image Classification , 2013, IEEE Geoscience and Remote Sensing Letters.

[12]  Xie Lun,et al.  Robot Emotion and Performance Regulation Based on HMM , 2013 .

[13]  Tian Yantao,et al.  Facial Expression Recognition Method Based on Gabor Multi-orientation Features Fusion and Block Histogram , 2011 .

[14]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[15]  W. Wundt,et al.  Principles of physiological psychology , 2015 .

[16]  Feng-chen Chang,et al.  Generalized Confidence Interval Estimation for the Difference in Paired Areas Under the ROC Curves in the Absence of a Gold Standard , 2013, Commun. Stat. Simul. Comput..

[17]  Cynthia Breazeal,et al.  Function meets style: insights from emotion theory applied to HRI , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  H. Schlosberg.  Three dimensions of emotion. , 1954, Psychological review.

[19]  Enzo Pasquale Scilingo,et al.  The Role of Nonlinear Dynamics in Affective Valence and Arousal Recognition , 2012, IEEE Transactions on Affective Computing.

[20]  Chen Jie,et al.  Histogram Sequence of Local Gabor Binary Pattern for Face Description and Identification , 2006 .

[21]  Liu Xin,et al.  Emotional state transition model based on stimulus and personality characteristics , 2013, China Communications.

[22]  María Malfaz,et al.  A New Approach to Modeling Emotions and Their Use on a Decision-Making System for Artificial Agents , 2012, IEEE Transactions on Affective Computing.

[23]  J. Gross.  Emotion Regulation: Past, Present, Future , 1999 .

[24]  R. Lazarus.  Relational meaning and discrete emotions. , 2001 .

[25]  Gerald Young,et al.  Approaches to Emotions , 2011 .

[26]  Myung Jin Chung,et al.  Stochastic approach on a simplified OCC model for uncertainty and believability , 2009, 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation - (CIRA).