DynEmo: A video database of natural facial expressions of emotions.

DynEmo is a database available to the scientific community (https://DynEmo.liglab.fr/). It contains dynamic and natural emotional facial expressions (EFEs) displaying subjective affective states rated by both the expresser and observers. Methodological and contextual information is provided for each expression. This multimodal corpus meets psychological, ethical, and technical criteria. It is quite large, containing two sets of 233 and 125 recordings of EFE of ordinary Caucasian people (ages 25 to 65, 182 females and 176 males) filmed in natural but standardized conditions. In the Set 1, EFE recordings are associated with the affective state of the expresser (self-reported after the emotion inducing task, using dimensional, action readiness, and emotional labels items). In the Set 2, EFE recordings are both associated with the affective state of the expresser and with the time line (continuous annotations) of observers' ratings of the emotions displayed throughout the recording. The time line allows any researcher interested in analysing non-verbal human behavior to segment the expressions into emotions.

[1]  E. Bould,et al.  Role of motion signals in recognizing subtle facial expressions of emotion. , 2008, British journal of psychology.

[2]  K. Scherer,et al.  A blueprint for affective computing: A sourcebook , 2010 .

[3]  W. Sato,et al.  BRIEF REPORT The dynamic aspects of emotional facial expressions , 2004 .

[4]  R. Adolphs.  Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[5]  James A. Russell,et al.  Are Facial Displays Social? Situational Influences in the Attribution of Emotion to Facial Expressions , 2002, The Spanish Journal of Psychology.

[6]  R. Calvo,et al.  New Perspectives on Affect and Learning Technologies , 2011 .

[7]  Timothy R. Jordan,et al.  The recognition of mental states from dynamic and static facial expressions , 2009 .

[8]  C. Deruelle,et al.  Motion and Emotion: A Novel Approach to the Study of Face Processing by Young Autistic Children , 2001, Journal of autism and developmental disorders.

[9]  Björn W. Schuller,et al.  AVEC 2012: the continuous audio/visual emotion challenge , 2012, ICMI '12.

[10]  D. Perrett,et al.  Categorical Perception of Morphed Facial Expressions , 1996 .

[11]  R. Gross.  Face Databases , 2005 .

[12]  Kostas Karpouzis,et al.  The HUMAINE Database: Addressing the Collection and Annotation of Naturalistic and Induced Emotional Data , 2007, ACII.

[13]  Qiang Ji,et al.  Facial Action Unit Recognition by Exploiting Their Dynamic and Semantic Relationships , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  C. Pelachaud,et al.  Emotion-Oriented Systems: The Humaine Handbook , 2011 .

[15]  Don M. Tucker,et al.  Asymmetry of Facial Expression in Spontaneous Emotion , 1984, Cortex.

[16]  Maja Pantic,et al.  The SEMAINE corpus of emotionally coloured character interactions , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[17]  D. Altman,et al.  A note on the use of the intraclass correlation coefficient in the evaluation of agreement between two methods of measurement. , 1990, Computers in biology and medicine.

[18]  Clinton D. Kilts,et al.  Dissociable Neural Pathways Are Involved in the Recognition of Emotion in Static and Dynamic Facial Expressions , 2003, NeuroImage.

[19]  K. Scherer,et al.  Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? , 2007, Emotion.

[20]  J. Fernández-Dols,et al.  False recognition of facial expressions of emotion: causes and implications. , 2008, Emotion.

[21]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[22]  P. Ekman,et al.  Behavioral Markers and Recognizability of the Smile of Enjoyment , 1993 .

[23]  W. Sato,et al.  Spontaneous facial mimicry in response to dynamic facial expressions , 2005, Cognition.

[24]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[25]  Skyler T. Hawk,et al.  Moving faces, looking places: validation of the Amsterdam Dynamic Facial Expression Set (ADFES). , 2011, Emotion.

[26]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[27]  A. Tcherkassof,et al.  Facial expressions of emotions: A methodological contribution to the study of spontaneous and dynamic emotional faces , 2007 .

[28]  Sakiko Yoshikawa,et al.  Enhanced perceptual, emotional, and motor processing in response to dynamic facial expressions of emotion1 , 2006 .

[29]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.

[31]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[32]  Judy Kegl,et al.  Moving Faces: Categorization of Dynamic Facial Expressions in American Sign Language by Deaf and Hearing Participants , 2007 .

[33]  Nadine Mandran,et al.  DYNEMO: A Corpus of dynamic and spontaneous emotional facial expressions , 2010 .

[34]  Maja Pantic,et al.  Fully Automatic Recognition of the Temporal Phases of Facial Actions , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Hatice Gunes,et al.  How to distinguish posed from spontaneous smiles using geometric features , 2007, ICMI '07.

[36]  Jessica L. Tracy,et al.  Development of a Facs-verified Set of Basic and Self-conscious Emotion Expressions Extant Facs-verified Sets , 2009 .

[37]  Jeffrey F. Cohn,et al.  The Timing of Facial Motion in posed and Spontaneous Smiles , 2003, Int. J. Wavelets Multiresolution Inf. Process..

[38]  J. Russell.  A circumplex model of affect. , 1980 .

[39]  Margaret McRorie,et al.  The Belfast Induced Natural Emotion Database , 2012, IEEE Transactions on Affective Computing.

[40]  K. Scherer,et al.  Studying the dynamics of emotional expression using synthesized facial muscle movements. , 2000, Journal of personality and social psychology.

[41]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[42]  U. Hess,et al.  Differentiating emotion elicited and deliberate emotional facial expressions , 1990 .

[43]  Maja Pantic,et al.  Spontaneous vs. posed facial behavior: automatic analysis of brow actions , 2006, ICMI '06.

[44]  N. Frijda,et al.  Facial expression and modes of action readiness , 1997 .

[45]  Zhaoyu Wang,et al.  Analyses of a Multimodal Spontaneous Facial Expression Database , 2013, IEEE Transactions on Affective Computing.

[46]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.