Processing of one, two or four natural scenes in humans: the limits of parallelism

The visual processing of objects in natural scenes is fast and efficient, as indexed by behavioral and ERP data [Nature 381 (1996) 520]. The results from a recent experiment suggested that such fast routines work in parallel across the visual field when subjects were presented with two natural scenes simultaneously [Nature Neurosci. 5 (2002) 629]. In the present experiment, the visual system was driven to its limits by presenting one, two or four scenes simultaneously. Behavior and ERP reveal a clear cost in processing an increasing number of scenes. However, a parallel-late selection model can still account for the results. This model is developed and discussed with reference to behavioral, single-unit and ERP data.

[1]  J Duncan,et al.  Responses of neurons in macaque area V4 during memory-guided visual search. , 2001, Cerebral cortex.

[2]  S. Luck,et al.  Spatio‐temporal dynamics of attention to color: Evidence from human electrophysiology , 1998, Human brain mapping.

[3]  J. Driver,et al.  Perceptual awareness and its loss in unilateral neglect and extinction , 2001, Cognition.

[4]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[5]  S. Luck,et al.  Bridging the Gap between Monkey Neurophysiology and Human Perception: An Ambiguity Resolution Theory of Visual Selective Attention , 1997, Cognitive Psychology.

[6]  U. Neisser.  VISUAL SEARCH. , 1964, Scientific American.

[7]  Michel Vidal-Naquet,et al.  Visual features of intermediate complexity and their use in classification , 2002, Nature Neuroscience.

[8]  H H Bülthoff,et al.  Detection of animals in natural images using far peripheral vision , 2001, The European journal of neuroscience.

[9]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[10]  S. Luck,et al.  Neural sources of focused attention in visual search. , 2000, Cerebral cortex.

[11]  S. Thorpe,et al.  The Time Course of Visual Processing: From Early Perception to Decision-Making , 2001, Journal of Cognitive Neuroscience.

[12]  A Treisman,et al.  Feature binding, attention and object perception. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[13]  S. Luck,et al.  Attention-Related Modulation of Sensory-Evoked Brain Activity in a Visual Search Task , 1993, Journal of Cognitive Neuroscience.

[14]  M. Posner,et al.  Frontal and inferior temporal cortical activity in visual target detection: Evidence from high spatially sampled event-related potentials , 1996, Brain Topography.

[15]  Bruno A Olshausen,et al.  Timecourse of neural signatures of object recognition. , 2003, Journal of vision.

[16]  Carl R Olson,et al.  Object-based vision and attention in primates , 2001, Current Opinion in Neurobiology.

[17]  J. J. Lange,et al.  Color selection and location selection in ERPs: differences, similarities and `neural specificity' , 1998, Biological Psychology.

[18]  R. Vogels.  Categorization of complex visual images by rhesus monkeys. Part 2: single‐cell study , 1999, The European journal of neuroscience.

[19]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[20]  Guillaume A. Rousselet,et al.  Parallel processing in high-level categorization of natural images , 2002, Nature Neuroscience.

[21]  S. Thorpe,et al.  A Limit to the Speed of Processing in Ultra-Rapid Visual Categorization of Novel Natural Scenes , 2001, Journal of Cognitive Neuroscience.

[22]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[23]  Earl K. Miller,et al.  Selective representation of relevant information by neurons in the primate prefrontal cortex , 1998, Nature.

[24]  R. Vogels.  Categorization of complex visual images by rhesus monkeys. Part 1: behavioural study , 1999, The European journal of neuroscience.

[25]  S J Luck,et al.  Spatial filtering during visual search: evidence from human electrophysiology. , 1994, Journal of experimental psychology. Human perception and performance.

[26]  J. Schall,et al.  Neural selection and control of visually guided eye movements. , 1999, Annual review of neuroscience.

[27]  G. Deco,et al.  The time course of selective visual attention: theory and experiments , 2002, Vision Research.

[28]  A. Dale,et al.  From retinotopy to recognition: fMRI in human visual cortex , 1998, Trends in Cognitive Sciences.

[29]  ● Pytorch,et al.  Attention! , 1998, Trends in Cognitive Sciences.

[30]  G. Rousselet,et al.  Is it an animal? Is it a human face? Fast processing in upright and inverted natural scenes. , 2003, Journal of vision.

[31]  Hans-Jochen Heinze,et al.  Localizing visual discrimination processes in time and space. , 2002, Journal of neurophysiology.

[32]  J. Tanji,et al.  Behavioral planning in the prefrontal cortex , 2001, Current Opinion in Neurobiology.

[33]  M C Polson,et al.  Hemispheres as independent resource systems: limited-capacity processing and cerebral specialization. , 1981, Journal of experimental psychology. Human perception and performance.

[34]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[35]  D. B. Bender,et al.  Visual Receptive Fields of Neurons in Inferotemporal Cortex of the Monkey , 1969, Science.

[36]  David L. Sheinberg,et al.  Noticing Familiar Objects in Real World Scenes: The Role of Temporal Cortical Neurons in Natural Vision , 2001, The Journal of Neuroscience.

[37]  Allen Allport,et al.  Visual attention , 1989 .

[38]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[39]  Steven A. Hillyard,et al.  Independent Attentional Scanning in the Separated Hemispheres of Split-Brain Patients , 1994, Journal of Cognitive Neuroscience.

[40]  L. Chelazzi.  Serial attention mechanisms in visual search: A critical look at the evidence , 1999, Psychological research.

[41]  D. Jeffreys.  Evoked Potential Studies of Face and Object Processing , 1996 .

[42]  Michèle Fabre-Thorpe,et al.  Interaction of top-down and bottom-up processing in the fast visual analysis of natural scenes. , 2004, Brain research. Cognitive brain research.

[43]  E. Vogel,et al.  The visual N1 component as an index of a discrimination process. , 2000, Psychophysiology.

[44]  R. Knight,et al.  Prefrontal modulation of visual processing in humans , 2000, Nature Neuroscience.

[45]  M. Tarr,et al.  The N170 occipito‐temporal component is delayed and enhanced to inverted faces but not to inverted objects: an electrophysiological account of face‐specific processes in the human brain , 2000, Neuroreport.

[46]  D. Tucker,et al.  Frontal evaluation and posterior representation in target detection. , 2001, Brain research. Cognitive brain research.

[47]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[48]  S C Rao,et al.  Integration of what and where in the primate prefrontal cortex. , 1997, Science.

[49]  D. Perrett,et al.  Visual neurones responsive to faces in the monkey temporal cortex , 2004, Experimental Brain Research.

[50]  T. Allison,et al.  Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. , 1999, Cerebral cortex.

[51]  Frank van der Velde,et al.  Using a recurrent network to bind form, color and position into a unified percept , 2001, Neurocomputing.

[52]  M. Potter.  Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[53]  N. P. Bichot,et al.  Continuous processing in macaque frontal cortex during visual search , 2001, Neuropsychologia.

[54]  M. Kutas,et al.  Neurophysiological evidence for visual perceptual categorization of words and faces within 150 ms. , 1998, Psychophysiology.

[55]  P. Perona,et al.  Rapid natural scene categorization in the near absence of attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[56]  G. R Mangun,et al.  Shifting visual attention in space: an electrophysiological analysis using high spatial resolution mapping , 2000, Clinical Neurophysiology.

[57]  J. Bullier.  Integrated model of visual processing , 2001, Brain Research Reviews.

[58]  J. Kenemans,et al.  Split-Second Sequential Selective Activation in Human Secondary Visual Cortex , 2002, Journal of Cognitive Neuroscience.

[59]  Stephen M. Kosslyn,et al.  Discrimination within and between hemifields: A new constraint on theories of attention , 1991, Neuropsychologia.

[60]  R. Knight,et al.  Lateral prefrontal damage affects processing selection but not attention switching. , 2002, Brain research. Cognitive brain research.

[61]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[62]  C. Gross,et al.  Visuotopic organization and extent of V3 and V4 of the macaque , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[63]  C. Koch,et al.  Category-specific visual responses of single neurons in the human medial temporal lobe , 2000, Nature Neuroscience.

[64]  Edmund T Rolls,et al.  The Receptive Fields of Inferior Temporal Cortex Neurons in Natural Scenes , 2003, The Journal of Neuroscience.

[65]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[66]  C. Koch,et al.  Visual Search and Dual Tasks Reveal Two Distinct Attentional Resources , 2004, Journal of Cognitive Neuroscience.

[67]  R. Vogels,et al.  Spatial sensitivity of macaque inferior temporal neurons , 2000, The Journal of comparative neurology.

[68]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[69]  I. Biederman.  Perceiving Real-World Scenes , 1972, Science.

[70]  S J Luck,et al.  Effects of spatial cuing on luminance detectability: psychophysical and electrophysiological evidence for early selection. , 1994, Journal of experimental psychology. Human perception and performance.

[71]  J. Maunsell,et al.  Anterior inferotemporal neurons of monkeys engaged in object recognition can be highly sensitive to object retinal position. , 2003, Journal of neurophysiology.

[72]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[73]  Vision Research , 1961, Nature.

[74]  S. Luck,et al.  The role of attention in feature detection and conjunction discrimination: an electrophysiological analysis. , 1995, The International journal of neuroscience.