Validation of the Amsterdam Dynamic Facial Expression Set – Bath Intensity Variations (ADFES-BIV): A Set of Videos Expressing Low, Intermediate, and High Intensity Emotions

Most of the existing sets of facial expressions of emotion contain static photographs. While increasing demand for stimuli with enhanced ecological validity in facial emotion recognition research has led to the development of video stimuli, these typically involve full-blown (apex) expressions. However, variations of intensity in emotional facial expressions occur in real life social interactions, with low intensity expressions of emotions frequently occurring. The current study therefore developed and validated a set of video stimuli portraying three levels of intensity of emotional expressions, from low to high intensity. The videos were adapted from the Amsterdam Dynamic Facial Expression Set (ADFES) and termed the Bath Intensity Variations (ADFES-BIV). A healthy sample of 92 people recruited from the University of Bath community (41 male, 51 female) completed a facial emotion recognition task including expressions of 6 basic emotions (anger, happiness, disgust, fear, surprise, sadness) and 3 complex emotions (contempt, embarrassment, pride) that were expressed at three different intensities of expression and neutral. Accuracy scores (raw and unbiased (Hu) hit rates) were calculated, as well as response times. Accuracy rates above chance level of responding were found for all emotion categories, producing an overall raw hit rate of 69% for the ADFES-BIV. The three intensity levels were validated as distinct categories, with higher accuracies and faster responses to high intensity expressions than intermediate intensity expressions, which had higher accuracies and faster responses than low intensity expressions. To further validate the intensities, a second study with standardised display times was conducted replicating this pattern. The ADFES-BIV has greater ecological validity than many other emotion stimulus sets and allows for versatile applications in emotion research. It can be retrieved free of charge for research purposes from the corresponding author.

[1]  David I. Perrett,et al.  The Emotion Recognition Task: A Paradigm to Measure the Perception of Facial Emotional Expressions at Different Intensities , 2007, Perceptual and motor skills.

[2]  Shigeru Akamatsu,et al.  Dynamic Properties Influence the Perception of Facial Expressions , 2001, Perception.

[3]  W. Sato,et al.  BRIEF REPORT The dynamic aspects of emotional facial expressions , 2004 .

[4]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[5]  Jessica L. Tracy,et al.  Development of a Facs-verified Set of Basic and Self-conscious Emotion Expressions Extant Facs-verified Sets , 2009 .

[6]  Pascal Belin,et al.  Recognition and discrimination of prototypical dynamic expressions of pain and emotions , 2008, PAIN®.

[7]  M. T. Motley,et al.  Facial expression of emotion: A comparison of posed expressions versus spontaneous expressions in an interpersonal communication setting , 1988 .

[8]  L. Derogatis,et al.  The SCL-90-R, Brief Symptom Inventory, and Matching Clinical Rating Scales. , 1999 .

[9]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[10]  P. Johnson-Laird,et al.  Towards a Cognitive Theory of Emotions , 1987 .

[11]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.

[12]  Guillermo Recio,et al.  Classification of dynamic facial expressions of emotion presented briefly , 2013, Cognition & emotion.

[13]  Nirbhay N. Singh,et al.  Concurrent Validity Studies of the Facial Discrimination Task , 2002 .

[14]  M. Dyck.  The Ability to Understand the Experience of Other People: Development and Validation of the Emotion Recognition Scales , 2012 .

[15]  E. Naito,et al.  Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study. , 2004, Brain research. Cognitive brain research.

[16]  P. Ekman.  Pictures of Facial Affect , 1976 .

[17]  Klaus R. Scherer,et al.  Understanding the Mechanisms Underlying the Production of Facial Expression of Emotion: A Componential Perspective , 2013 .

[18]  R. Adolphs.  Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[19]  K. Lander,et al.  Independence of face identity and expression processing: exploring the role of motion , 2015, Front. Psychol..

[20]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[21]  Marco Tamietto,et al.  Attention and awareness each influence amygdala activity for dynamic bodily expressions—a short review , 2012, Front. Integr. Neurosci..

[22]  Juliane Jung,et al.  Understanding Motivation And Emotion , 2016 .

[23]  L. Nummenmaa,et al.  Time course of discrimination between emotional facial expressions: The role of visual saliency , 2011, Vision Research.

[24]  Jessica L. Tracy,et al.  The Automaticity of Emotion Recognition , 2007 .

[25]  H. Wagner.  The accessibility of the term “contempt” and the meaning of the unilateral lip curl , 2000 .

[26]  H. Bülthoff,et al.  The MPI Facial Expression Database — A Validated Database of Emotional and Conversational Facial Expressions , 2012, PloS one.

[27]  L. Rubin.  The Mechanism of Human Facial Expression , 1992 .

[28]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[29]  Alex Martin,et al.  Facial Emotion Recognition in Autism Spectrum Disorders: A Review of Behavioral and Neuroimaging Studies , 2010, Neuropsychology Review.

[30]  R. Gur,et al.  Neural circuitry for accurate identification of facial emotions , 2008, Brain Research.

[31]  K. Scherer,et al.  Acoustic profiles in vocal emotion expression. , 1996, Journal of personality and social psychology.

[32]  David Matsumoto,et al.  Culture and Psychology , 1995 .

[33]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[34]  P. Ekman.  Universals and cultural differences in facial expressions of emotion. , 1972 .

[35]  P. Ekman,et al.  Personality Processes and Individual Differences the Relationship among Expressions, Labels, and Descriptions of Contempt , 2022 .

[36]  D. Perrett,et al.  Caricaturing facial expressions , 2000, Cognition.

[37]  H. Wagner.  On measuring performance in category judgment studies of nonverbal behavior , 1993 .

[38]  P. Niedenthal,et al.  When did her smile drop? Facial mimicry and the influences of emotional state on the detection of change in emotional expression , 2001 .

[39]  K. Scherer,et al.  Emotion recognition from expressions in face, voice, and body: the Multimodal Emotion Recognition Test (MERT). , 2009, Emotion.

[40]  M. Herrmann,et al.  Emotions in motion: Dynamic compared to static facial expressions of disgust and happiness reveal more widespread emotion-specific activations , 2009, Brain Research.

[41]  G. Boulogne,et al.  The Mechanism of Human Facial Expression , 1990 .

[42]  P. Gosselin,et al.  Components and recognition of facial expression in the communication of emotion by actors. , 1995, Journal of personality and social psychology.

[43]  J. Hietanen,et al.  Positive facial expressions are recognized faster than negative facial expressions, but why? , 2004, Psychological research.

[44]  W. Sato,et al.  Enhanced facial EMG activity in response to dynamic facial expressions. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[45]  A. Manstead,et al.  Effects of Dynamic Aspects of Facial Expressions: A Review , 2013 .

[46]  D. Perrett,et al.  Computer-enhanced emotion in facial expressions , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[47]  S. Baron-Cohen,et al.  The Autism-Spectrum Quotient (AQ): Evidence from Asperger Syndrome/High-Functioning Autism, Malesand Females, Scientists and Mathematicians , 2001, Journal of autism and developmental disorders.

[48]  F. Gosselin,et al.  The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing , 2008, Behavior research methods.

[49]  Richard W. Robins,et al.  The self-conscious emotions: Theory and research. , 2007 .

[50]  Giuliano Geminiani,et al.  Effects of emotional face cueing on line bisection in neglect: A single case study , 2005, Neurocase.

[51]  F. Gosselin,et al.  Audio-visual integration of emotion expression , 2008, Brain Research.

[52]  Takahiro Hoshino,et al.  Measuring individual differences in sensitivities to basic emotions in faces , 2006, Cognition.

[53]  P. Ekman,et al.  Pan-Cultural Elements in Facial Displays of Emotion , 1969, Science.

[54]  Emanuel Schmider,et al.  Is It Really Robust , 2010 .

[55]  S. Campanella,et al.  Integrating face and voice in person perception , 2007, Trends in Cognitive Sciences.

[56]  R. Kestenbaum,et al.  Neural and behavioral correlates of emotion recognition in children and adults. , 1992, Journal of experimental child psychology.

[57]  E. Bould,et al.  Recognising subtle emotional expressions: The role of facial movements , 2008 .

[58]  P. Ekman.  An argument for basic emotions , 1992 .

[59]  K. Scherer,et al.  Introducing the Geneva Multimodal expression corpus for experimental research on emotion perception. , 2012, Emotion.

[60]  Robert L. Leahy,et al.  The Use of Psychological Testing for Treatment Planning and Outcome Assessment , 2000, Journal of Cognitive Psychotherapy.

[61]  J. Hietanen,et al.  Is there more in a happy face than just a big smile? , 2007 .

[62]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[63]  P. Niedenthal,et al.  Emotional state and the detection of change in facial expression of emotion , 2000 .

[64]  D. Rollins,et al.  Detecting powder mixture inhomogeneity for non-normal measurement errors , 1997 .

[65]  A. Anderson,et al.  Neural Correlates of the Automatic Processing of Threat Facial Signals , 2022 .

[66]  D. Matsumoto,et al.  Judgments of subtle facial expressions of emotion. , 2014, Emotion.

[67]  G. Horstmann.  What do facial expressions convey: feeling states, behavioral intentions, or action requests? , 2003, Emotion.

[68]  D. Lundqvist,et al.  Facial expressions of emotion (KDEF): Identification under different display-duration conditions , 2008, Behavior research methods.

[69]  J. Theeuwes,et al.  Faces capture attention: Evidence from inhibition of return , 2006 .

[70]  E. Bould,et al.  Role of motion signals in recognizing subtle facial expressions of emotion. , 2008, British journal of psychology.

[71]  Sakiko Yoshikawa,et al.  Enhanced perceptual, emotional, and motor processing in response to dynamic facial expressions of emotion1 , 2006 .

[72]  Oliver G. B. Garrod,et al.  Dynamic Facial Expressions of Emotion Transmit an Evolving Hierarchy of Signals over Time , 2014, Current Biology.

[73]  F. Pollick,et al.  Recognising Facial Expression from Spatially and Temporally Modified Movements , 2003, Perception.

[74]  Shichuan Du,et al.  The resolution of facial expressions of emotion. , 2011, Journal of vision.

[75]  Skyler T. Hawk,et al.  Moving faces, looking places: validation of the Amsterdam Dynamic Facial Expression Set (ADFES). , 2011, Emotion.

[76]  U. Hess,et al.  The Intensity of Emotional Facial Expressions and Decoding Accuracy , 1997 .

[77]  Fabio Pianesi,et al.  A first evaluation study of a database of kinetic facial expressions (DaFEx) , 2005, ICMI '05.

[78]  J. Tanaka,et al.  The NimStim set of facial expressions: Judgments from untrained research participants , 2009, Psychiatry Research.

[79]  N. Ambady,et al.  The neural basis of contextual influences on face categorization. , 2015, Cerebral cortex.

[80]  K. Scherer,et al.  Studying the dynamics of emotional expression using synthesized facial muscle movements. , 2000, Journal of personality and social psychology.

[81]  W. Sato,et al.  Dynamic facial expressions of emotion induce representational momentum , 2008, Cognitive, affective & behavioral neuroscience.

[82]  Reginald B. Adams,et al.  The face is not an empty canvas: how facial expressions interact with facial appearance , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[83]  Lucy I Mullin,et al.  A female advantage in the recognition of emotional facial expressions: test of an evolutionary hypothesis , 2006 .

[84]  P. Ekman,et al.  A new pan-cultural facial expression of emotion , 1986 .

[85]  A. Ortony,et al.  What's basic about basic emotions? , 1990, Psychological review.

[86]  U. Hess,et al.  Differentiating emotion elicited and deliberate emotional facial expressions , 1990 .

[87]  Matthew G. Rhodes,et al.  Age estimation of faces: a review† , 2009 .

[88]  A. J. Fridlund.  Human Facial Expression: An Evolutionary View , 1994 .

[89]  Lauri Nummenmaa,et al.  Recognition of Facial Expressions of Emotion is Related to their Frequency in Everyday Life , 2014, Journal of Nonverbal Behavior.

[90]  Nalini Ambady,et al.  Accurate identification of fear facial expressions predicts prosocial behavior. , 2007, Emotion.

[91]  A. M. Burton,et al.  Sex Discrimination: How Do We Tell the Difference between Male and Female Faces? , 1993, Perception.

[92]  Hillary Anger Elfenbein,et al.  Cross-cultural patterns in emotion recognition: highlighting design and analytical techniques. , 2002 .