Measuring individual differences in sensitivities to basic emotions in faces

The assessment of individual differences in facial expression recognition is normally required to address two major issues: (1) high agreement level (ceiling effect) and (2) differential difficulty levels across emotions. We propose a new assessment method designed to quantify individual differences in the recognition of the six basic emotions, 'sensitivities to basic emotions in faces.' We attempted to address the two major assessment issues by using morphing techniques and item response theory (IRT). We used morphing to create intermediate, mixed facial expression stimuli with various levels of recognition difficulty. Applying IRT enabled us to estimate the individual latent trait levels underlying the recognition of respective emotions (sensitivity scores), unbiased by stimulus properties that constitute difficulty. In a series of two experiments we demonstrated that the sensitivity scores successfully addressed the two major assessment issues and their concomitant individual variability. Intriguingly, correlational analyses of the sensitivity scores to different emotions produced orthogonality between happy and non-happy emotion recognition. To our knowledge, this is the first report of the independence of happiness recognition, unaffected by stimulus difficulty.

[1]  B. Reed,et al.  Development of psychometrically matched English and Spanish language neuropsychological tests for older persons. , 2000, Neuropsychology.

[2]  K. Lesch,et al.  Association of Anxiety-Related Traits with a Polymorphism in the Serotonin Transporter Gene Regulatory Region , 1996, Science.

[3]  C. Izard Innate and universal facial expressions: evidence from developmental and cross-cultural research. , 1994, Psychological bulletin.

[4]  R. Blair,et al.  Facial expressions, their communicatory functions and neuro-cognitive substrates. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[5]  J. Russell,et al.  Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults. , 1985 .

[6]  Bonnie L. Angelone,et al.  Categorical Perception of Race , 2002, Perception.

[7]  P. Ekman,et al.  Smiles when lying. , 1988, Journal of personality and social psychology.

[8]  P. Ekman,et al.  Matsumoto and Ekman's Japanese and Caucasian Facial Expressions of Emotion (JACFEE): Reliability Data and Cross-National Differences , 1997 .

[9]  A. Young,et al.  Neuropsychology of fear and loathing , 2001 .

[10]  P. J. Ferrando The accuracy of the E, N and P trait estimates: an empirical study using the EPQ-R , 2003 .

[11]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[12]  D. Perrett,et al.  Caricaturing facial expressions , 2000, Cognition.

[13]  D. Perrett,et al.  Loss of disgust. Perception of faces and emotions in Huntington's disease. , 1996, Brain : a journal of neurology.

[14]  W. Sato,et al.  Seeing Happy Emotion in Fearful and Angry Faces: Qualitative Analysis of Facial Expression Recognition in a Bilateral Amygdala-Damaged Patient , 2002, Cortex.

[15]  M. Gazzaniga,et al.  Cognitive Neuroscience: The Biology of the Mind , 1998 .

[16]  R. Davidson,et al.  The functional neuroanatomy of emotion and affective style , 1999, Trends in Cognitive Sciences.

[17]  S Z Rapcsak,et al.  Fear recognition deficits after focal brain damage: a cautionary note. , 2000, Neurology.

[18]  A. Young,et al.  Recognition of facial emotion in nine individuals with bilateral amygdala damage , 1999, Neuropsychologia.

[19]  F. Samejima Estimation of latent ability using a response pattern of graded scores , 1968 .

[20]  J. Russell,et al.  The psychology of facial expression: Frontmatter , 1997 .

[21]  Francis Tuerlinckx,et al.  Measuring needs with the thematic apperception test: a psychometric study. , 2002, Journal of personality and social psychology.

[22]  M. Egan,et al.  Serotonin Transporter Genetic Variation and the Response of the Human Amygdala , 2002, Science.

[23]  H. Yamada Visual Information for Categorizing Facial Expression of Emotions , 1993 .

[24]  M. Fredrikson,et al.  Human fear conditioning is related to dopaminergic and serotonergic biological markers. , 2001, Behavioral neuroscience.

[25]  R. Adolphs,et al.  The human amygdala in social judgment , 1998, Nature.

[26]  R. Ebstein,et al.  Dopamine D4 receptor (D4DR) exon III polymorphism associated with the human personality trait of Novelty Seeking , 1996, Nature Genetics.

[27]  Andrew W. Young,et al.  Face processing impairments after encephalitis: amygdala damage and recognition of fear , 1998, Neuropsychologia.

[28]  H. Bülthoff,et al.  Categorical perception of familiar objects , 2002, Cognition.

[29]  A. Calder Facial Emotion Recognition after Bilateral Amygdala Damage: Differentially Severe Impairment of Fear , 1996 .

[30]  R. Adolphs,et al.  Dissociable neural systems for recognizing emotions , 2003, Brain and Cognition.

[31]  G. Matthews,et al.  Emotional Intelligence: Science and Myth , 2003 .

[32]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[33]  Hiroshi Yamada,et al.  American-Japanese cultural differences in judgements of emotional expressions of different intensities , 2002 .

[34]  R. Adolphs,et al.  The human amygdala in social judgement , 2000 .

[35]  D. Hamer Rethinking Behavior Genetics , 2002, Science.

[36]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[37]  J. Russell The psychology of facial expression: Reading emotions from and into faces: Resurrecting a dimensional-contextual perspective , 1997 .

[38]  H. Schlosberg The description of facial expressions in terms of two dimensions. , 1952, Journal of experimental psychology.

[39]  P. Johnston,et al.  Differential susceptibility to performance degradation across categories of facial emotion—a model confirmation , 2003, Biological Psychology.

[40]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[41]  D. Perrett,et al.  Categorical Perception of Morphed Facial Expressions , 1996 .

[42]  David I. Perrett,et al.  Recognition of facial expressions : Selective impairment of specific emotions in Huntington's disease , 1997 .

[43]  R. Adolphs,et al.  Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala , 1994, Nature.

[44]  P. Johnson-Laird,et al.  Towards a Cognitive Theory of Emotions , 1987 .

[45]  F. Keil,et al.  Categorical effects in the perception of faces , 1995, Cognition.

[46]  H. Yamada,et al.  Dimensions of visual information for categorizing facial expressions of emotion , 1993 .

[47]  U. Hess,et al.  Deficits in recognition of emotional facial expression are still present in alcoholics after mid- to long-term abstinence. , 2001, Journal of studies on alcohol.

[48]  E. McClure A meta-analytic review of sex differences in facial expression processing and their development in infants, children, and adolescents. , 2000, Psychological bulletin.

[49]  R. Davidson Emotion and Affective Style: Hemispheric Substrates , 1992 .

[50]  S. Reise,et al.  How many IRT parameters does it take to model psychopathology items? , 2003, Psychological methods.

[51]  P. Ekman Emotion in the human face , 1982 .

[52]  D. Perrett,et al.  Facial expression megamix: Tests of dimensional and category accounts of emotion recognition , 1997, Cognition.

[53]  Paul Ekman,et al.  Does image size affect judgments of the face? , 1979 .

[54]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[55]  P. Boeck,et al.  Simple mental addition in children with and without mild mental retardation. , 1999, Journal of experimental child psychology.

[56]  T. Duka,et al.  Mixed emotions: alcoholics’ impairments in the recognition of specific emotional facial expressions , 2003, Neuropsychologia.

[57]  Judith A. Hall Gender Effects in Decoding Nonverbal Cues , 1978 .

[58]  Eiji Muraki,et al.  Fitting a Polytomous Item Response Model to Likert-Type Data , 1990 .

[59]  P. Ekman Pictures of Facial Affect , 1976 .

[60]  P. Ekman,et al.  A New Test to Measure Emotion Recognition Ability: Matsumoto and Ekman's Japanese and Caucasian Brief Affect Recognition Test (JACBART) , 2000 .

[61]  Kazuo Shigemasu,et al.  Application of the somatic marker hypothesis to individual differences in decision making , 2003, Biological Psychology.

[62]  Y. Ono,et al.  GENETIC AND ENVIRONMENTAL STRUCTURE OF CLONINGER'S TEMPERAMENT AND CHARACTER DIMENSIONS , 2004 .

[63]  J. Russell Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[64]  R. Adolphs Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[65]  S. Embretson,et al.  Item response theory for psychologists , 2000 .

[66]  Daniel Tranel,et al.  Preferences for Visual Stimuli Following Amygdala Damage , 1999, Journal of Cognitive Neuroscience.

[67]  E. Diener,et al.  The independence of positive and negative affect. , 1984, Journal of personality and social psychology.

[68]  D. Watson,et al.  Toward a consensual structure of mood. , 1985, Psychological bulletin.

[69]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm , 1981 .

[70]  Robert Plomin,et al.  A Quantitative Trait Locus Associated With Cognitive Ability in Children , 1998 .

[71]  J. Russell Facial expressions of emotion: what lies beyond minimal universality? , 1995, Psychological bulletin.

[72]  R. Adolphs,et al.  Fear and the human amygdala , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[73]  L. Nadel,et al.  Cognitive neuroscience of emotion , 2000 .

[74]  U. Hess,et al.  The Intensity of Emotional Facial Expressions and Decoding Accuracy , 1997 .