Automated facial coding software outperforms people in recognizing neutral faces as neutral from standardized datasets

Little is known about people’s accuracy of recognizing neutral faces as neutral. In this paper, I demonstrate the importance of knowing how well people recognize neutral faces. I contrasted human recognition scores of 100 typical, neutral front-up facial images with scores of an arguably objective judge – automated facial coding (AFC) software. I hypothesized that the software would outperform humans in recognizing neutral faces because of the inherently objective nature of computer algorithms. Results confirmed this hypothesis. I provided the first-ever evidence that computer software (90%) was more accurate in recognizing neutral faces than people were (59%). I posited two theoretical mechanisms, i.e., smile-as-a-baseline and false recognition of emotion, as possible explanations for my findings.

[1]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  Vlad I. Morariu,et al.  Expression , 2015, Principles of Molecular Virology.

[3]  P. Lewinski,et al.  Warsaw set of emotional facial expression pictures: a validation study of facial display photographs , 2015, Front. Psychol..

[4]  Katherine B. Martin,et al.  Facial Action Coding System , 2015 .

[5]  Tim M. den Uyl,et al.  Automated facial coding: validation of basic emotions and FACS AUs in FaceReader , 2014 .

[6]  G. Watson,et al.  Using Physiological Measures to Assess the Effects of Animated Pedagogical Agents on Multimedia Instruction , 2014 .

[7]  Eduardo B. Andrade,et al.  Moral Violations Reduce Oral Consumption. , 2014, Journal of consumer psychology : the official journal of the Society for Consumer Psychology.

[8]  Joseph H. Goldberg,et al.  Measuring Software Screen Complexity: Relating Eye Tracking, Emotional Valence, and Subjective Ratings , 2014, Int. J. Hum. Comput. Interact..

[9]  E. Tan,et al.  Predicting advertising effectiveness by facial expressions in response to amusing persuasive stimuli. , 2014 .

[10]  Darrin J. Griffin.  Nonverbal bilingualism: Deaf schemas of deception , 2014 .

[11]  J. Russell,et al.  Universality Revisited , 2013 .

[12]  M. Chóliz,et al.  Recognition of Emotional Facial Expressions: The Role of Facial and Contextual Information in the Accuracy of Recognition , 2012, Psychological reports.

[13]  Skyler T. Hawk,et al.  Moving faces, looking places: validation of the Amsterdam Dynamic Facial Expression Set (ADFES). , 2011, Emotion.

[14]  J. Tsai,et al.  Self-focused attention and emotional reactivity: the role of culture. , 2010, Journal of personality and social psychology.

[15]  L. Leyman,et al.  The Karolinska Directed Emotional Faces: A validation study , 2008 .

[16]  J. Fernández-Dols,et al.  False recognition of facial expressions of emotion: causes and implications. , 2008, Emotion.

[17]  Jae-Jin Kim,et al.  Is a neutral face really evaluated as being emotionally neutral? , 2008, Psychiatry Research.

[18]  Ursula Hess,et al.  Postauricular and eyeblink startle responses to facial expressions. , 2007, Psychophysiology.

[19]  M. den Uyl,et al.  The FaceReader: Online facial expression recognition , 2006 .

[20]  Marco Wiering,et al.  A Model Based Method for Automatic Facial Expression Recognition , 2005, ECML.

[21]  Reginald B. Adams,et al.  Facial appearance, gender, and emotion expression. , 2004, Emotion.

[22]  J. Hietanen,et al.  Depression biases the recognition of emotionally neutral faces , 2004, Psychiatry Research.

[23]  D. Keltner,et al.  Culture and Facial Expression: Open-ended Methods Find More Expressions and a Gradient of Recognition , 1999 .

[24]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[25]  James A. Russell,et al.  The psychology of facial expression: What does a facial expression mean? , 1997 .

[26]  J. Russell.  Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[27]  P. Ekman,et al.  EMFACS-7: Emotional Facial Action Coding System , 1983 .

[28]  P. Ekman,et al.  Facial Action Coding System: Manual , 1978 .