General recognition theory with individual differences: a new method for examining perceptual and decisional interactions with an application to face perception

A common question in perceptual science is to what extent different stimulus dimensions are processed independently. General recognition theory (GRT) offers a formal framework via which different notions of independence can be defined and tested rigorously, while also dissociating perceptual from decisional factors. This article presents a new GRT model that overcomes several shortcomings with previous approaches, including a clearer separation between perceptual and decisional processes and a more complete description of such processes. The model assumes that different individuals share similar perceptual representations, but vary in their attention to dimensions and in the decisional strategies they use. We apply the model to the analysis of interactions between identity and emotional expression during face recognition. The results of previous research aimed at this problem have been disparate. Participants identified four faces, which resulted from the combination of two identities and two expressions. An analysis using the new GRT model showed a complex pattern of dimensional interactions. The perception of emotional expression was not affected by changes in identity, but the perception of identity was affected by changes in emotional expression. There were violations of decisional separability of expression from identity and of identity from expression, with the former being more consistent across participants than the latter. One explanation for the disparate results in the literature is that decisional strategies may have varied across studies and influenced the results of tests of perceptual interactions, as previous studies lacked the ability to dissociate between perceptual and decisional interactions.

[1]  A. Wald Tests of statistical hypotheses concerning several parameters when the number of observations is large , 1943 .

[2]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[3]  H. Akaike A new look at the statistical model identification , 1974 .

[4]  W. R. Garner The Processing of Information and Structure , 1974 .

[5]  N. Etcoff,et al.  Selective attention to facial identity and facial emotion , 1984, Neuropsychologia.

[6]  J. Hartigan,et al.  The Dip Test of Unimodality , 1985 .

[7]  N. Perrin,et al.  Varieties of perceptual independence. , 1986, Psychological review.

[8]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[9]  R. Nosofsky,et al.  Predicting similarity and categorization from identification. , 1991, Journal of experimental psychology. General.

[10]  James T. Townsend,et al.  Implications of marginal and conditional detection parameters for the separabilities and independence of perceptual dimensions , 1992 .

[11]  W. T. Maddox,et al.  A response time theory of separability and integrality in speeded classification , 1994 .

[12]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[13]  W T Maddox,et al.  Perceptual separability, decisional separability, and the identification-speeded classification relationship. , 1996, Journal of experimental psychology. Human perception and performance.

[14]  P. Spreij Probability and Measure , 1996 .

[15]  Maddox Wt,et al.  Perceptual separability, decisional separability, and the identification-speeded classification relationship. , 1996 .

[16]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[17]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[18]  S. Schweinberger,et al.  Asymmetric relationships among perceptions of facial identity, emotion, and facial speech. , 1998, Journal of experimental psychology. Human perception and performance.

[19]  A M Burton,et al.  Asymmetric dependencies in perceiving identity and emotion: Experiments with morphed faces , 1999, Perception & psychophysics.

[20]  S. R. Lehky Fine Discrimination of Faces can be Performed Rapidly , 2000, Journal of Cognitive Neuroscience.

[21]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[22]  N. Kanwisher Domain specificity in face perception , 2000, Nature Neuroscience.

[23]  R D Thomas,et al.  Perceptual interactions of facial dimensions in speeded classification and identification , 2001, Perception & psychophysics.

[24]  I. Biederman,et al.  Inferior Temporal Neurons Show Greater Sensitivity to Nonaccidental than to Metric Shape Differences , 2001, Journal of Cognitive Neuroscience.

[25]  Gregory Ashby,et al.  Suboptimality in human categorization and identification. , 2001, Journal of experimental psychology. General.

[26]  Brian J Stankiewicz,et al.  Empirical evidence for independent dimensions in the visual representation of three-dimensional shape. , 2002, Journal of experimental psychology. Human perception and performance.

[27]  Nicolas Franck,et al.  Selective attention to facial emotion and identity in schizophrenia , 2002, Neuropsychologia.

[28]  W. T. Maddox,et al.  Multiple attention systems in perceptual categorization , 2002, Memory & cognition.

[29]  Tzvi Ganel,et al.  Effects of familiarity on the perceptual integrality of the identity and expression of faces: the parallel-route hypothesis revisited. , 2004, Journal of experimental psychology. Human perception and performance.

[30]  David R. Anderson,et al.  Multimodel Inference , 2004 .

[31]  Kenneth F. Valyear,et al.  The involvement of the “fusiform face area” in processing facial expression , 2005, Neuropsychologia.

[32]  T. Griffiths,et al.  Modeling individual differences using Dirichlet processes , 2006 .

[33]  Christopher J. Fox,et al.  What is adapted in face adaptation? The neural representations of expression in the human visual system , 2007, Brain Research.

[34]  A. Anderson,et al.  Examinations of identity invariance in facial expression adaptation , 2008, Cognitive, affective & behavioral neuroscience.

[35]  N. Kanwisher,et al.  Interpreting fMRI data: maps, modules and dimensions , 2008, Nature Reviews Neuroscience.

[36]  Christopher J. Fox,et al.  It doesn't matter how you feel. The facial identity aftereffect is invariant to changes in facial expression. , 2008, Journal of vision.

[37]  Isabel Gauthier,et al.  Holistic processing of faces: perceptual and decisional components. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[38]  Caroline Blais,et al.  Orientation invariance in visual shape perception. , 2009, Journal of vision.

[39]  Chantal Kemner,et al.  Is the early modulation of brain activity by fearful facial expressions primarily mediated by coarse low spatial frequency information? , 2009, Journal of vision.

[40]  M. Lee,et al.  Individual differences in attention during category learning , 2010 .

[41]  R. Catrambone,et al.  Proceedings of the 32nd Annual Conference of the Cognitive Science Society , 2010 .

[42]  Nick Donnelly,et al.  Perceptual and decisional factors influencing the discrimination of inversion in the Thatcher illusion. , 2011, Journal of experimental psychology. Human perception and performance.

[43]  Michael L. Mack,et al.  Indecision on decisional separability , 2011, Psychonomic bulletin & review.

[44]  Fabian A. Soto,et al.  Asymmetrical interactions in the perception of face identity and emotional expression are not unique to the primate visual system. , 2011, Journal of vision.

[45]  G. Humphreys,et al.  Interactions between facial emotion and identity in face processing: Evidence based on redundancy gains , 2012, Attention, Perception, & Psychophysics.

[46]  Noah H Silbert,et al.  Syllable structure and integration of voicing and manner of articulation information in labial consonant identification. , 2012, The Journal of the Acoustical Society of America.

[47]  Edgar C. Merkle,et al.  The problem of model selection uncertainty in structural equation modeling. , 2012, Psychological methods.

[48]  Nick Donnelly,et al.  Identifying Sources of Configurality in Three Face Processing Tasks , 2012, Front. Psychology.

[49]  Daniel Fitousi,et al.  Variants of independence in the perception of facial identity and expression. , 2013, Journal of experimental psychology. Human perception and performance.

[50]  Noah H. Silbert,et al.  Decisional separability, model identification, and statistical inference in the general recognition theory framework , 2013, Psychonomic bulletin & review.

[51]  A. Richards,et al.  Overlapping facial expression representations are identity-dependent , 2013, Vision Research.

[52]  Joachim Vandekerckhove,et al.  Oxford Handbook of Computational and Mathematical Psychology , 2014 .

[53]  Technical clarification to Silbert and Thomas (2013): “Decisional separability, model identification, and statistical inference in the general recognition theory framework” , 2014, Psychonomic bulletin & review.

[54]  F. Gregory Ashby,et al.  Multidimensional Models of Perception and Cognition , 2014 .

[55]  Fabian A. Soto,et al.  Multidimensional Signal Detection Theory , 2015, Cognitive Choice Modeling.

[56]  Péter Szigetvári,et al.  What and When? , 2019, Inauguration and Liturgical Kingship in the Long Twelfth Century.