Gauging response time distributions to examine the effect of facial expression inversion

Introduction We used images of facial expressions (FEs) of emotion in a speeded Same/Different task to examine (i) distributional characteristics of response times (RTs) in relation to inter-stimulus similarity and (ii) the impact of inversion on FE processing. Methods Stimuli were seven emotion prototypes, posed by one male and one female, and eight intermediate morphs. Image pairs (N = 225) were presented for 500 ms, upright or inverted, in a block design, each 100 times. Results For both upright and inverted FEs, RTs were a non-monotonic function: median values were longest for stimulus pairs of intermediate similarity, decreasing for both more-dissimilar and more-similar pairs. RTs of “Same” and “Different” judgments followed ex-Gaussian distributions. The non-monotonicity is interpreted within a dual-process decision model framework as reflecting the infrequency of identical pairs, shifting the balance between the Same and Different processes. The effect of stimulus inversion was gauged by comparing RT-based multidimensional scaling solutions for the two presentation modes. Solutions for upright and inverted FEs showed little difference, with both displaying some evidence of categorical perception. The same features appeared in hierarchical clustering solutions. Discussion This outcome replicates and reinforces the solutions derived from accuracy of “Different” responses reported in our earlier companion paper. We attribute this lack of inversion effect to the brief exposure time, allowing low-level visual processing to dominate Same/Different decisions while elevating early featural analysis, which is insensitive to face orientation but enables initial positive/negative valence categorization of FEs.

[1]  T. Agostini,et al.  Attentional capture in emotion comparison is orientation independent , 2022, Psychological Research.

[2]  Robin A. A. Ince,et al.  Network mechanisms of dynamic feature selection for flexible visual categorizations , 2022, 2205.04393.

[3]  B. Farell Hypothesis testing, attention, and ‘Same’-‘Different’ judgments , 2021, Cognitive Psychology.

[4]  Katie L. H. Gray,et al.  Inverted faces benefit from whole-face processing , 2020, Cognition.

[5]  Andrew Heathcote,et al.  Dynamic models of choice , 2018, Behavior Research Methods.

[6]  Mario Del Líbano,et al.  What makes a smiling face look happy? Visual saliency, distinctiveness, and affect , 2018, Psychological research.

[7]  Hailing Wang,et al.  N170 Reveals the Categorical Perception Effect of Emotional Valence , 2017, Front. Psychol..

[8]  C. Oliveira,et al.  The Effect of Corrective Feedback on Performance in Basic Cognitive Tasks: An Analysis of RT Components , 2016, Psychologica Belgica.

[9]  Simon Cassidy,et al.  Cognitive Style: Time to Experiment , 2016, Front. Psychol..

[10]  T. Mussweiler,et al.  Immediate relativity: EEG reveals early engagement of comparison in social information processing. , 2016, Journal of experimental psychology. General.

[11]  Lauri Nummenmaa,et al.  Perceptual and affective mechanisms in facial expression recognition: An integrative review , 2016, Cognition & emotion.

[12]  Yue Chen,et al.  Greater Perceptual Sensitivity to Happy Facial Expression , 2014, Perception.

[13]  T. Andrews,et al.  Inversion Improves the Recognition of Facial Expression in Thatcherized Images , 2014, Perception.

[14]  B. Rossion Understanding face perception by means of human electrophysiology , 2014, Trends in Cognitive Sciences.

[15]  L. Nummenmaa,et al.  Facial expression recognition in peripheral versus central vision: role of the eyes and the mouth , 2014, Psychological research.

[16]  Mélanie Perron,et al.  Featural processing in recognition of emotional facial expressions , 2014, Cognition & emotion.

[17]  Marianne Schmid Mast,et al.  Emotion Recognition: The Role of Featural and Configural Face Information , 2013, Quarterly journal of experimental psychology.

[18]  Shichuan Du,et al.  Wait, are you sad or angry? Large exposure time differences required for the categorization of facial expressions of emotion. , 2013, Journal of vision.

[19]  Slawomir J. Skwarek,et al.  Processing Facial Expressions of Emotion: Upright vs. Inverted Images , 2012, Front. Psychology.

[20]  Mark W. Becker Negative emotional photographs are identified more slowly than positive photographs , 2012, Attention, perception & psychophysics.

[21]  Derek H. Arnold,et al.  Discrepant Integration Times for Upright and Inverted Faces , 2011, Perception.

[22]  L. Nummenmaa,et al.  Time course of discrimination between emotional facial expressions: The role of visual saliency , 2011, Vision Research.

[23]  D. Balota,et al.  Moving Beyond the Mean in Studies of Mental Chronometry , 2011 .

[24]  Roger Ratcliff,et al.  Individual differences, aging, and IQ in two-choice tasks , 2010, Cognitive Psychology.

[25]  Philippe G Schyns,et al.  Smile Through Your Fear and Sadness , 2009, Psychological science.

[26]  E. Wagenmakers,et al.  Psychological interpretation of the ex-Gaussian and shifted Wald parameters: A diffusion model analysis , 2009, Psychonomic bulletin & review.

[27]  O. Lipp,et al.  No effect of inversion on attentional and affective processing of facial expressions. , 2009, Emotion.

[28]  J. D. Smith,et al.  The comparative psychology of same-different judgments by humans (Homo sapiens) and monkeys (Macaca mulatta). , 2008, Journal of experimental psychology. Animal behavior processes.

[29]  B. Rossion Picture-plane inversion leads to qualitative changes of face perception. , 2008, Acta psychologica.

[30]  M. Eimer,et al.  Event-related brain potential correlates of emotional face processing , 2007, Neuropsychologia.

[31]  Patrik Vuilleumier,et al.  Time course and specificity of event-related potentials to emotional expressions , 2004, Neuroreport.

[32]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[33]  D. Wright,et al.  An own gender bias and the importance of hair in face recognition. , 2003, Acta psychologica.

[34]  David E. Huber,et al.  Persistence and accommodation in short‐term priming and other perceptual paradigms: temporal segregation through synaptic depression , 2003 .

[35]  David Bimler,et al.  Categorical perception of facial expressions of emotion: Evidence from multidimensional scaling , 2001 .

[36]  R M Nosofsky,et al.  An exemplar-retrieval model of speeded same--different judgments. , 2000, Journal of experimental psychology. Human perception and performance.

[37]  W. Cain,et al.  Latency and accuracy of discriminations of odor quality between binary mixtures and their components. , 2000, Chemical senses.

[38]  C. Cavonius,et al.  Color spaces of color-normal and color-abnormal observers reconstructed from response times and dissimilarity ratings , 1999, Perception & psychophysics.

[39]  Jules Davidoff,et al.  Similarity and categorisation: neuropsychological evidence for a dissociation in explicit categorisation tasks , 1999, Cognition.

[40]  D. Balota,et al.  Word frequency, repetition, and lexicality effects in word recognition tasks: beyond measures of central tendency. , 1999, Journal of experimental psychology. General.

[41]  D. Perrett,et al.  Facial expression megamix: Tests of dimensional and category accounts of emotion recognition , 1997, Cognition.

[42]  D. Perrett,et al.  Categorical Perception of Morphed Facial Expressions , 1996 .

[43]  D. Mewhort,et al.  Analysis of Response Time Distributions: An Example Using the Stroop Task , 1991 .

[44]  S. Nowicki,et al.  The role of locus of control orientation in speed of discriminating facial affect , 1990 .

[45]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[46]  Yoshio Takane,et al.  Structures in two-choice reaction-time data. , 1987 .

[47]  John D. Mollon,et al.  The discriminability of colours on c.r.t. displays , 1986 .

[48]  B. Farell,et al.  Same-different judgments: a review of current controversies in perceptual comparisons. , 1985, Psychological bulletin.

[49]  R. Ratcliff Theoretical interpretations of the speed and accuracy of positive and negative responses. , 1985, Psychological review.

[50]  Yoshio Takane,et al.  Multidimensional scaling models for reaction times and same-different judgments , 1983 .

[51]  Lester E. Krueger,et al.  A reformulation of Proctor's unified theory for matching-task phenomena , 1981 .

[52]  R. Ratcliff,et al.  Speed and accuracy of same and different responses in perceptual matching , 1981, Perception & psychophysics.

[53]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[54]  L. Cooper,et al.  Mental transformations and visual comparison processes: effects of complexity and similarity. , 1976, Journal of experimental psychology. Human perception and performance.

[55]  Lynn A. Cooper,et al.  Individual differences in visual comparison processes , 1976 .

[56]  J. Gower Generalized procrustes analysis , 1975 .

[57]  Bruce D. Downing Response probabilities and “same-different” reaction times , 1971 .

[58]  Forrest W. Young Nonmetric scaling of line lengths using latencies, similarity, and same-different judgments , 1970 .

[59]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[60]  Slawomir J. Skwarek,et al.  COMPARING REACTION TIMES AND ACCURACY RATES IN A SAME / DIFFERENT TASK WITH FACIAL EXPRESSIONS , 2009 .

[61]  K. Shigemasu,et al.  Temporal Characteristics of Categorical Perception of Emotional Facial Expressions , 2004 .

[62]  W. R. Garner,et al.  Reaction time as a measure of inter- and intraobject visual similarity: Letters of the alphabet , 1979 .

[63]  P. Ekman Pictures of Facial Affect , 1976 .