Seeing the future: Natural image sequences produce “anticipatory” neuronal activity and bias perceptual report

This paper relates human perception to the functioning of cells in the temporal cortex that are engaged in high-level pattern processing. We review historical developments concerning (a) the functional organization of cells processing faces and (b) the selectivity for faces in cell responses. We then focus on (c) the comparison of perception and cell responses to images of faces presented in sequences of unrelated images. Specifically the paper concerns the cell function and perception in circumstances where meaningful patterns occur momentarily in the context of a naturally or unnaturally changing visual environment. Experience of visual sequences allows anticipation, yet one sensory stimulus also “masks” perception and neural processing of subsequent stimuli. To understand this paradox we compared cell responses in monkey temporal cortex to body images presented individually, in pairs and in action sequences. Responses to one image suppressed responses to similar images for ∼500 ms. This suppression led to responses peaking 100 ms earlier to image sequences than to isolated images (e.g., during head rotation, face-selective activity peaks before the face confronts the observer). Thus forward masking has unrecognized benefits for perception because it can transform neuronal activity to make it predictive during natural change.

[1]  C. Gross Single neuron studies of inferior temporal cortex , 2008, Neuropsychologia.

[2]  Keiji Tanaka,et al.  Object category structure in response patterns of neuronal population in monkey inferior temporal cortex. , 2007, Journal of neurophysiology.

[3]  S. Dehaene,et al.  Levels of processing during non-conscious perception: a critical review of visual masking , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  Tjeerd Jellema,et al.  Neural representations of perceived bodily actions using a categorical frame of reference , 2006, Neuropsychologia.

[5]  G. Luppino,et al.  Cortical connections of the inferior parietal cortical convexity of the macaque monkey. , 2006, Cerebral cortex.

[6]  Doris Y. Tsao,et al.  A Cortical Region Consisting Entirely of Face-Selective Cells , 2006, Science.

[7]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[8]  G. Orban,et al.  Selectivity of Neuronal Adaptation Does Not Match Response Selectivity: A Single-Cell Study of the fMRI Adaptation Paradigm , 2006, Neuron.

[9]  J. Duncan EPS Mid-Career Award 2004: Brain mechanisms of attention , 2006, Quarterly journal of experimental psychology.

[10]  A. Zador,et al.  Synaptic Mechanisms of Forward Suppression in Rat Auditory Cortex , 2005, Neuron.

[11]  M. Meister,et al.  Dynamic predictive coding by the retina , 2005, Nature.

[12]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[13]  D. I. Perrett,et al.  Out of sight but not out of mind: the neurophysiology of iconic memory in the superior temporal sulcus , 2005, Cognitive neuropsychology.

[14]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[15]  D J Simons,et al.  Adaptation in thalamic barreloid and cortical barrel neurons to periodic whisker deflections varying in frequency and velocity. , 2004, Journal of neurophysiology.

[16]  Alexander Thiele,et al.  Effects on orientation perception of manipulating the spatio–temporal prior probability of stimuli , 2004, Vision Research.

[17]  T. Poggio,et al.  Cognitive neuroscience: Neural mechanisms for the recognition of biological movements , 2003, Nature Reviews Neuroscience.

[18]  Yang Dan,et al.  Dynamic Modification of Cortical Orientation Tuning Mediated by Recurrent Connections , 2002, Neuron.

[19]  E. Miller,et al.  Dynamics of neuronal sensitivity in visual cortex and local feature discrimination , 2002, Nature Neuroscience.

[20]  Christian Keysers,et al.  Visual masking and RSVP reveal neural competition , 2002, Trends in Cognitive Sciences.

[21]  Karl Verfaillie,et al.  Representing and anticipating human actions in vision , 2002 .

[22]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[23]  Z Kourtzi,et al.  Representation of Perceived Object Shape by the Human Lateral Occipital Complex , 2001, Science.

[24]  D. Perrett,et al.  Neural Representation for the Perception of the Intentionality of Actions , 2000, Brain and Cognition.

[25]  M. Shiffrar,et al.  New aspects of motion perception: selective neural encoding of apparent human movements , 2000, Neuroreport.

[26]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[27]  Michael J. Berry,et al.  Anticipation of moving stimuli by the retina , 1999, Nature.

[28]  D. Perrett,et al.  Evidence accumulation in cell populations responsive to faces: an account of generalisation of recognition without mental transformations , 1998, Cognition.

[29]  M. Livingstone,et al.  Neuronal correlates of visibility and invisibility in the primate visual system , 1998, Nature Neuroscience.

[30]  M. W. Brown,et al.  Differential neuronal encoding of novelty, familiarity and recency in regions of the anterior temporal lobe , 1998, Neuropharmacology.

[31]  D. Perrett,et al.  Eye-direction detection: A dissociation between geometric and joint attention skills in autism , 1997 .

[32]  D. Perrett,et al.  Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey. , 1996, Journal of neurophysiology.

[33]  Keiji Tanaka,et al.  Optical Imaging of Functional Organization in the Monkey Inferotemporal Cortex , 1996, Science.

[34]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[35]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[36]  D. Perrett,et al.  Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque. , 1994, Cerebral cortex.

[37]  R. Desimone,et al.  The representation of stimulus familiarity in anterior inferior temporal cortex. , 1993, Journal of neurophysiology.

[38]  Minami Ito,et al.  Columns for visual features of objects in monkey inferotemporal cortex , 1992, Nature.

[39]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[40]  Y. Miyashita,et al.  Neural organization for the long-term memory of paired associates , 1991, Nature.

[41]  Keiji Tanaka,et al.  Coding visual images of objects in the inferotemporal cortex of the macaque monkey. , 1991, Journal of neurophysiology.

[42]  D I Perrett,et al.  Frameworks of analysis for the neural representation of animate objects and actions. , 1989, The Journal of experimental biology.

[43]  P. Lennie,et al.  Pattern-selective adaptation in visual cortical neurones , 1979, Nature.

[44]  D. Perrett,et al.  Visual neurones responsive to faces in the monkey temporal cortex , 2004, Experimental Brain Research.

[45]  D. Perrett,et al.  Rapid serial visual presentation for the determination of neural selectivity in area STSa. , 2004, Progress in brain research.

[46]  Gillian Rhodes,et al.  When Is a Face Not a Face? The Effects of Misorientation on Mechanisms of Face Perception , 2003 .

[47]  P. Fldik,et al.  The Speed of Sight , 2001, Journal of Cognitive Neuroscience.

[48]  M. Harries,et al.  Visual Processing of Faces in Temporal Cortex: Physiological Evidence for a Modular Organization and Possible Anatomical Correlates , 1991, Journal of Cognitive Neuroscience.

[49]  R. Desimone Face-Selective Cells in the Temporal Cortex of Monkeys , 1991, Journal of Cognitive Neuroscience.

[50]  A. J. Mistlin,et al.  Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. , 1984, Human neurobiology.

[51]  M. Turvey On peripheral and central processes in vision: inferences from an information-processing analysis of masking with patterned stimuli. , 1973, Psychological review.

[52]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.