The Time Course of Perceptual Grouping in Natural Scenes

Visual perception starts with localized filters that subdivide the image into fragments that undergo separate analyses. The visual system has to reconstruct objects by grouping image fragments that belong to the same object. A widely held view is that perceptual grouping occurs in parallel across the visual scene and without attention. To test this idea, we measured the speed of grouping in pictures of animals and vehicles. In a classification task, these pictures were categorized efficiently. In an image-parsing task, participants reported whether two cues fell on the same or different objects, and we measured reaction times. Despite the participants’ fast object classification, perceptual grouping required more time if the distance between cues was larger, and we observed an additional delay when the cues fell on different parts of a single object. Parsing was also slower for inverted than for upright objects. These results imply that perception starts with rapid object classification and that rapid classification is followed by a serial perceptual grouping phase, which is more efficient for objects in a familiar orientation than for objects in an unfamiliar orientation.

[1]  H. Spekreijse,et al.  A gradual spread of attention during mental curve tracing. , 2003, Perception & psychophysics.

[2]  Michel Vidal-Naquet,et al.  Visual features of intermediate complexity and their use in classification , 2002, Nature Neuroscience.

[3]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[4]  P. Roelfsema,et al.  Automatic spread of attentional response modulation along Gestalt criteria in primary visual cortex , 2011, Nature Neuroscience.

[5]  W. Singer,et al.  Detecting connectedness. , 1998, Cerebral cortex.

[6]  Ohad Ben-Shahar,et al.  Attention, segregation, and textons: Bridging the gap between object-based attention and texton-based segregation , 2007, Vision Research.

[7]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[8]  P. Roelfsema Cortical algorithms for perceptual grouping. , 2006, Annual review of neuroscience.

[9]  M. Tovée Neuronal Processing: How fast is the speed of thought? , 1994, Current Biology.

[10]  M. Peterson,et al.  Shape recognition contributions to figure-ground reversal: which route counts? , 1991, Journal of experimental psychology. Human perception and performance.

[11]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[12]  J. Duncan Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[13]  D. Sagi,et al.  Visual attention and perceptual grouping , 1992, Perception & psychophysics.

[14]  Sarah Walker,et al.  Ultra-rapid categorization requires visual attention: Scenes with multiple foreground objects. , 2008, Journal of vision.

[15]  Pieter R. Roelfsema,et al.  Object-based attention in the primary visual cortex of the macaque monkey , 1998, Nature.

[16]  M. Farah,et al.  Is visual image segmentation a bottom-up or an interactive process? , 1997, Perception & psychophysics.

[17]  S. Ullman,et al.  Curve tracing: A possible basic operation in the perception of spatial relations , 1986, Memory & cognition.

[18]  H E Egeth,et al.  Mental curve tracing with elementary stimuli. , 1988, Journal of experimental psychology. Human perception and performance.

[19]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[20]  M. Koivisto,et al.  Recurrent Processing in V1/V2 Contributes to Categorization of Natural Scenes , 2011, The Journal of Neuroscience.

[21]  P. Perona,et al.  Rapid natural scene categorization in the near absence of attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[22]  K Tanaka,et al.  Neuronal mechanisms of object recognition. , 1993, Science.

[23]  P Jolicoeur,et al.  Size invariance in curve tracing , 1991, Memory & cognition.

[24]  R. O’Reilly,et al.  Figure-ground organization and object recognition processes: an interactive account. , 1998, Journal of experimental psychology. Human perception and performance.

[25]  Pieter R Roelfsema,et al.  Parallel and serial grouping of image elements in visual perception. , 2010, Journal of experimental psychology. Human perception and performance.

[26]  G. Rousselet,et al.  Is it an animal? Is it a human face? Fast processing in upright and inverted natural scenes. , 2003, Journal of vision.

[27]  H. H. Clark The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. , 1973 .

[28]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[29]  S. Grossberg,et al.  Texture segregation by visual cortex: Perceptual grouping, attention, and learning , 2007, Vision Research.

[30]  M. Farah,et al.  Does visual attention select objects or locations? , 1994, Journal of experimental psychology. General.

[31]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[32]  P. Roelfsema,et al.  Incremental grouping of image elements in vision , 2011, Attention, perception & psychophysics.

[33]  T. Poggio,et al.  Are Cortical Models Really Bound by the “Binding Problem”? , 1999, Neuron.

[34]  Victor A. F. Lamme,et al.  Synchrony and covariation of firing rates in the primary visual cortex during contour grouping , 2004, Nature Neuroscience.

[35]  S Ullman,et al.  Visual curve tracing properties. , 1991, Journal of experimental psychology. Human perception and performance.

[36]  Li Fei-Fei,et al.  Neural mechanisms of rapid natural scene categorization in human visual cortex , 2009, Nature.

[37]  Ronen Basri,et al.  Hierarchy and adaptivity in segmenting visual scenes , 2006, Nature.

[38]  Christine Lefebvre,et al.  Electrophysiological evidence of enhanced cortical activity in the human brain during visual curve tracing , 2010, Vision Research.

[39]  John K. Tsotsos,et al.  The different stages of visual recognition need different attentional binding strategies , 2008, Brain Research.

[40]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[41]  J. Driver,et al.  Segmentation, attention and phenomenal visual objects , 2001, Cognition.