Temporal Contiguity Training Influences Behavioral and Neural Measures of Viewpoint Tolerance.

Humans can often recognize faces across viewpoints despite the large changes in low-level image properties a shift in viewpoint introduces. We present a behavioral and an fMRI adaptation experiment to investigate whether this viewpoint tolerance is reflected in the neural visual system and whether it can be manipulated through training. Participants saw training sequences of face images creating the appearance of a rotating head. Half of the sequences showed faces undergoing veridical changes in appearance across the rotation (non-morph condition). The other half were non-veridical: during rotation, the face simultaneously morphed into another face. This procedure should successfully associate frontal face views with side views of the same or a different identity, and, according to the temporal contiguity hypothesis, thus enhance viewpoint tolerance in the non-morph condition and/or break tolerance in the morph condition. Performance on the same/different task in the behavioral experiment (N = 20) was affected by training. There was a significant interaction between training (associated/not associated) and identity (same/different), mostly reflecting a higher confusion of different identities when they were associated during training. In the fMRI study (N = 20), fMRI adaptation effects were found for same-viewpoint images of untrained faces, but no adaptation for untrained faces was present across viewpoints. Only trained faces which were not morphed during training elicited a slight adaptation across viewpoints in face-selective regions. However, both in the behavioral and in the neural data the effects were small and weak from a statistical point of view. Overall, we conclude that the findings are not inconsistent with the proposal that temporal contiguity can influence viewpoint tolerance, with more evidence for tolerance when faces are not morphed during training.

[1]  Stefan R Schweinberger,et al.  Dominance of texture over shape in facial identity processing is modulated by individual abilities , 2017, British journal of psychology.

[2]  H. Bülthoff,et al.  A shape-based account for holistic face processing. , 2016, Journal of experimental psychology. Learning, memory, and cognition.

[3]  J. S. Guntupalli,et al.  Disentangling the Representation of Identity from Head View Along the Human Face Processing Pathway , 2016, bioRxiv.

[4]  Johan Wagemans,et al.  How learning might strengthen existing visual object representations in human object-selective cortex , 2016, NeuroImage.

[5]  Edward A. Wasserman,et al.  Promoting rotational-invariance in object recognition despite experience with only a single view , 2016, Behavioural Processes.

[6]  Galit Yovel,et al.  A Revised Neural Framework for Face Processing. , 2015, Annual review of vision science.

[7]  Kalanit Grill-Spector,et al.  Spatiotemporal information during unsupervised learning enhances viewpoint invariant object recognition. , 2015, Journal of vision.

[8]  Keiji Tanaka,et al.  Neural Substrates of View-Invariant Object Recognition Developed without Experiencing Rotations of the Objects , 2014, The Journal of Neuroscience.

[9]  Bozana Meinhardt-Injac,et al.  Holistic Face Processing is Induced by Shape and Texture , 2013, Perception.

[10]  H. P. Op de Beeck,et al.  Representations of Facial Identity Information in the Ventral Visual Stream Investigated with Multivoxel Pattern Analyses , 2013, The Journal of Neuroscience.

[11]  Jonathan R. Folstein,et al.  Category learning increases discriminability of relevant object dimensions in visual cortex. , 2013, Cerebral cortex.

[12]  Jonathan R. Folstein,et al.  How category learning affects object representations: not all morphspaces stretch alike. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[13]  J. DiCarlo,et al.  Neuronal Learning of Invariant Object Representation in the Ventral Visual Stream Is Not Dependent on Reward , 2012, The Journal of Neuroscience.

[14]  Nancy Kanwisher,et al.  An algorithmic method for functionally defining regions of interest in the ventral visual pathway , 2012, NeuroImage.

[15]  Daniel D. Dilks,et al.  Mirror-Image Sensitivity and Invariance in Object and Scene Processing Pathways , 2011, The Journal of Neuroscience.

[16]  Marlene Behrmann,et al.  Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis , 2011, Proceedings of the National Academy of Sciences.

[17]  I. Biederman,et al.  Loci of the release from fMRI adaptation for changes in facial expression, identity, and viewpoint. , 2010, Journal of vision.

[18]  J. DiCarlo,et al.  Unsupervised Natural Visual Experience Rapidly Reshapes Size-Invariant Object Representation in Inferior Temporal Cortex , 2010, Neuron.

[19]  Nikolaus Kriegeskorte,et al.  Face-identity change activation outside the face system: "release from adaptation" may not always indicate neuronal selectivity. , 2010, Cerebral cortex.

[20]  Keiji Tanaka,et al.  View‐invariant object recognition ability develops after discrimination, not mere exposure, at several viewing angles , 2010, The European journal of neuroscience.

[21]  Jiye G. Kim,et al.  Adaptation in the fusiform face area (FFA): Image or person? , 2009, Vision Research.

[22]  Bruno Rossion,et al.  Recognizing an individual face: 3D shape contributes earlier than 2D surface reflectance information , 2009, NeuroImage.

[23]  G. Pourtois,et al.  Object representations for multiple visual categories overlap in lateral occipital and medial fusiform cortex. , 2009, Cerebral cortex.

[24]  Guy Wallis,et al.  Learning Illumination-and Orientation-invariant Representations of Objects through Temporal Association General Methods Experiment Ii , 2022 .

[25]  Johan Wagemans,et al.  Subordinate Categorization Enhances the Neural Selectivity in Human Object-selective Cortex for Fine Shape Differences , 2009, Journal of Cognitive Neuroscience.

[26]  A. Kleinschmidt,et al.  Graded size sensitivity of object-exemplar-evoked activity patterns within human LOC subregions. , 2008, Journal of neurophysiology.

[27]  James J. DiCarlo,et al.  Unsupervised Natural Experience Rapidly Alters Invariant Object Representation in Visual Cortex , 2008, Science.

[28]  Johan Wagemans,et al.  The representation of subordinate shape similarity in human occipitotemporal cortex. , 2008, Journal of vision.

[29]  Timothy J. Andrews,et al.  Differential sensitivity for viewpoint between familiar and unfamiliar faces in human visual cortex , 2008, NeuroImage.

[30]  Raymond J. Dolan,et al.  fMRI Activity Patterns in Human LOC Carry Information about Object Exemplars within Category , 2008, Journal of Cognitive Neuroscience.

[31]  R. Goebel,et al.  Individual faces elicit distinct response patterns in human anterior temporal cortex , 2007, Proceedings of the National Academy of Sciences.

[32]  F. Fang,et al.  Duration-dependent FMRI adaptation and distributed viewer-centered face representation in human visual cortex. , 2007, Cerebral cortex.

[33]  M. Riesenhuber,et al.  Categorization Training Results in Shape- and Category-Selective Human Neural Plasticity , 2007, Neuron.

[34]  K. Nakayama,et al.  The Cambridge Face Memory Test: Results for neurologically intact individuals and an investigation of its validity using inverted face stimuli and prosopagnosic participants , 2006, Neuropsychologia.

[35]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[36]  A. O'Toole,et al.  Probing the Visual Representation of Faces With Adaptation , 2006, Psychological science.

[37]  G. Boynton,et al.  Adaptation: from single cells to BOLD signals , 2006, Trends in Neurosciences.

[38]  M. Riesenhuber,et al.  Evaluation of a Shape-Based Model of Human Face Discrimination Using fMRI and Behavioral Techniques , 2006, Neuron.

[39]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[40]  E. Miller,et al.  Experience-dependent sharpening of visual shape selectivity in inferior temporal cortex. , 2005, Cerebral cortex.

[41]  Keiji Tanaka,et al.  Prior experience of rotation is not required for recognizing objects seen from different angles , 2005, Nature Neuroscience.

[42]  David D. Cox,et al.  'Breaking' position-invariant object recognition , 2005, Nature Neuroscience.

[43]  Raymond J. Dolan,et al.  Familiarity enhances invariance of face representations in human ventral visual cortex: fMRI evidence , 2005, NeuroImage.

[44]  Gilles Pourtois,et al.  Portraits or People? Distinct Representations of Face Identity in the Human Visual Cortex , 2005, Journal of Cognitive Neuroscience.

[45]  Gilles Pourtois,et al.  View-independent coding of face identity in frontal and temporal cortices is modulated by familiarity: an event-related fMRI study , 2005, NeuroImage.

[46]  Timothy J. Andrews,et al.  Distinct representations for facial identity and changeable aspects of faces in the human temporal lobe , 2004, NeuroImage.

[47]  R. Dolan,et al.  fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. , 2004, Journal of neurophysiology.

[48]  M. Chee,et al.  Stimulus repetition and hemodynamic response refractoriness in event‐related fMRI , 2003, Human brain mapping.

[49]  M. Behrmann,et al.  Impact of learning on representation of parts and wholes in monkey inferotemporal cortex , 2002, Nature Neuroscience.

[50]  Z Kourtzi,et al.  Representation of Perceived Object Shape by the Human Lateral Occipital Complex , 2001, Science.

[51]  H. Bülthoff,et al.  Effects of temporal association on recognition memory , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[52]  K. Grill-Spector,et al.  fMR-adaptation: a tool for studying the functional properties of human cortical neurons. , 2001, Acta psychologica.

[53]  N. Kanwisher,et al.  Cortical Regions Involved in Perceiving Object Shape , 2000, The Journal of Neuroscience.

[54]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[55]  Thomas Vetter,et al.  Three-dimensional shape and two-dimensional surface reflectance contributions to face recognition: an application of three-dimensional morphing , 1999, Vision Research.

[56]  Keiji Tanaka,et al.  Effects of shape-discrimination training on the selectivity of inferotemporal cells in adult monkeys. , 1998, Journal of neurophysiology.

[57]  N. Kanwisher,et al.  Covert visual attention modulates face-specific activity in the human fusiform gyrus: fMRI study. , 1998, Journal of neurophysiology.

[58]  Robert L. Goldstone Influences of categorization on perceptual discrimination. , 1994, Journal of experimental psychology. General.

[59]  E T Rolls,et al.  Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[60]  Peter Földiák,et al.  Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[61]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[62]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[63]  E. Wojciulik,et al.  Attention increases neural selectivity in the human lateral occipital complex , 2004, Nature Neuroscience.

[64]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.