When a face is (or is not) more than the sum of its features: Configural and analytic processes in facial temporal integration

To investigate temporal integration in face recognition, top and bottom halves of pictures of famous people were presented sequentially, either upright or inverted, with varying temporal intervals between the two halves. The inversion effect, a marker of configural processing, was comparable across 0–400 ms intervals, but decreased at intervals exceeding 400 ms (Exp. 1). When an interfering stimulus appeared during the interval between the two face parts (Exp. 2), it disrupted the integration of the parts but not their perception. This is the first report of such an effect. Thus, performance equalled the combined accuracy of each part when presented alone, which in turn was worse than when they were integrated. Our findings indicate that (a) configural processing of faces depends on integration of face parts that are maintained temporarily in a visual buffer; (b) without integration, identification depends on recognition of individual parts whose contributions are additive; and (c) an interfering visual stimulus can obstruct integration, but leaves perception of individual parts intact. The ability to integrate temporally separated face parts into a unified representation is discussed in light of theories of face perception and temporal integration.

[1]  Maria V. Sanchez-Vives,et al.  Hyperpolarization-activated graded persistent activity in the prefrontal cortex , 2008, Proceedings of the National Academy of Sciences.

[2]  J. Sergent.  Microgenesis of Face Perception , 1986 .

[3]  David E. Irwin,et al.  Temporal integration between visual images and visual percepts. , 2002, Journal of experimental psychology. Human perception and performance.

[4]  James W. Tanaka,et al.  The holistic representation of faces. , 2003 .

[5]  Heather Buttle,et al.  High familiarity enhances visual change detection for face stimuli , 2003, Perception & psychophysics.

[6]  M. Moscovitch,et al.  Early versus late stages of processing and their relation to functional hemispheric asymmetries in face recognition. , 1976, Journal of experimental psychology. Human perception and performance.

[7]  Andrew Hollingworth,et al.  The role of visual short-term memory in empty cell localization , 2005, Perception & psychophysics.

[8]  V. Bruce,et al.  The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology When Inverted Faces Are Recognized: the Role of Configural Information in Face Recognition , 2022 .

[9]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[10]  H. Wilson,et al.  Configural masking of faces: Evidence for high-level interactions in face perception , 2005, Vision Research.

[11]  I. Fraser,et al.  Reaction Time Measures of Feature Saliency in Schematic Faces , 1990, Perception.

[12]  N. Haig.  Exploring Recognition with Interchanged Facial Features , 1986, Perception.

[13]  W. A. Phillips.  On the distinction between sensory storage and short-term visual memory , 1974 .

[14]  J. Duncan,et al.  On the time course of perceptual information that results from a brief visual presentation. , 1992, Journal of experimental psychology. Human perception and performance.

[15]  G. Winocur,et al.  What Is Special about Face Recognition? Nineteen Experiments on a Person with Visual Object Agnosia and Dyslexia but Normal Face Recognition , 1997, Journal of Cognitive Neuroscience.

[16]  I. Gauthier,et al.  How does the brain process upright and inverted faces? , 2002, Behavioral and cognitive neuroscience reviews.

[17]  C. Curtis,et al.  Persistent activity in the prefrontal cortex during working memory , 2003, Trends in Cognitive Sciences.

[18]  David E. Irwin.  Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[19]  D. E. Irwin,et al.  Visual Memory Within and Across Fixations , 1992 .

[20]  V Bruce,et al.  Configural Features in the Context of Upright and Inverted Faces , 2001, Perception.

[21]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[22]  G. Rhodes,et al.  Change detection in the flicker paradigm: Do faces have an advantage? , 2003 .

[23]  A. Hollingworth.  Visual memory for natural scenes: Evidence from change detection and visual search , 2006 .

[24]  Nicholas Costen,et al.  One extreme or the other or perhaps the golden mean? Issues of spatial resolution in face processing , 1999 .

[25]  Andrew Hollingworth,et al.  Eye Movements, Visual Memory, and Scene Representation , 2000 .

[26]  R. Yin.  Looking at Upside-down Faces , 1969 .

[27]  G. Humphreys,et al.  Attending but not seeing: The "other race" effect in face and person perception studied through change blindness , 2005 .

[28]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[29]  Jedediah M. Singer,et al.  Holistic processing unites face parts across time , 2006, Vision Research.

[30]  D. Maurer,et al.  The many faces of configural processing , 2002, Trends in Cognitive Sciences.

[31]  David E. Irwin,et al.  Sensory registration and informational persistence. , 1986, Journal of experimental psychology. Human perception and performance.

[32]  F. Gosselin,et al.  CATEGORIZATION OF OBJECTS, SCENES, AND FACES THROUGH TIME , 2005 .

[33]  Vincent Di Lollo,et al.  Temporal integration in visual memory. , 1980, Journal of experimental psychology. General.

[34]  S. Carey,et al.  Why faces are and are not special: an effect of expertise. , 1986, Journal of experimental psychology. General.

[35]  A. Hollingworth.  Constructing visual representations of natural scenes: the roles of short- and long-term visual memory. , 2004, Journal of experimental psychology. Human perception and performance.

[36]  D. I. Perrett,et al.  Out of sight but not out of mind: the neurophysiology of iconic memory in the superior temporal sulcus , 2005, Cognitive neuropsychology.

[37]  D. E. Irwin.  Integrating Information Across Saccadic Eye Movements , 1996 .

[38]  K. Rayner.  Eye movements and visual cognition : scene perception and reading , 1992 .

[39]  Frédéric Gosselin,et al.  Bubbles: a technique to reveal the use of information in recognition tasks , 2001, Vision Research.

[40]  Talma Hendler,et al.  Enhanced temporal non-linearities in human object-related occipito-temporal cortex. , 2004, Cerebral cortex.

[41]  Donald D. Hoffman,et al.  Attention to Faces: A Change-Blindness Study , 2002, Perception.

[42]  Bruno Rossion,et al.  Faces are "spatial"--holistic face perception is supported by low spatial frequencies. , 2006, Journal of experimental psychology. Human perception and performance.

[43]  H. Bülthoff,et al.  Effects of temporal association on recognition memory , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[44]  James L. McClelland,et al.  Information integration in perception and communication , 1996 .

[45]  M. Tovée,et al.  Processing speed in the cerebral cortex and the neurophysiology of visual masking , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[46]  M. Farah,et al.  What causes the face inversion effect? , 1995, Journal of experimental psychology. Human perception and performance.

[47]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[48]  Jason J S Barton,et al.  Attending to Faces: Change Detection, Familiarization, and Inversion Effects , 2003, Perception.

[49]  Gillian Rhodes,et al.  What's lost in inverted faces? , 1993, Cognition.

[50]  M. Moscovitch,et al.  Temporal integration in face perception: evidence of configural processing of temporally separated face parts. , 2007, Journal of experimental psychology. Human perception and performance.

[51]  J. Murray.  The Ups and Downs of Face Perception: Evidence for Holistic Encoding of Upright and Inverted Faces , 2004, Perception.

[52]  J. Bartlett,et al.  Inversion and processing of component and spatial-relational information in faces. , 1996, Journal of experimental psychology. Human perception and performance.

[53]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[54]  Margot J. Taylor,et al.  Spatio temporal dynamics of face recognition. , 2008, Cerebral cortex.

[55]  N. Lavie,et al.  Changing Faces: A Detection Advantage in the Flicker Paradigm , 2001, Psychological science.

[56]  J. Bartlett,et al.  Inversion and processing of component and spatial–relational information in faces. , 1996 .

[57]  Frédéric Gosselin,et al.  Spatio-temporal dynamics of face recognition in a flash: it's in the eyes , 2004, Cogn. Sci..