Spatiotemporal mechanisms for detecting and identifying image features in human vision

Our visual system constantly selects salient features in the environment, so that only those features are attended and targeted by further processing efforts to identify them. Models of feature detection hypothesize that salient features are localized based on contrast energy (local variance in intensity) in the visual stimulus. This hypothesis, however, has not been tested directly. We used psychophysical reverse correlation to study how humans detect and identify basic image features (bars and short line segments). Subjects detected a briefly flashed 'target bar' that was embedded in 'noise bars' that randomly changed in intensity over space and time. By studying how the intensity of the noise bars affected performance, we were able to dissociate two processing stages: an early 'detection' stage, whereby only locations of high-contrast energy in the image are selected, followed (after ∼100 ms) by an 'identification' stage, whereby image intensity at selected locations is used to determine the identity (whether bright or dark) of the target.

[1]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[2]  Daniel A. Pollen,et al.  Visual cortical neurons as localized spatial frequency filters , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[4]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[5]  D. Spalding.  The Principles of Psychology , 1873, Nature.

[6]  E DITORS,et al.  Who and what. , 1975, Pediatrics.

[7]  Clyde Arthur Morrison,et al.  Theory and Data , 1992 .

[8]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[9]  A. Ahumada.  Perceptual Classification Images from Vernier Acuity Masked by Noise , 1996 .

[10]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[11]  D. Tolhurst,et al.  The detection and identification of lines and edges , 1975, Vision Research.

[12]  J P Thomas,et al.  Underlying psychometric function for detecting gratings and identifying spatial frequency. , 1983, Journal of the Optical Society of America.

[13]  Christopher W. Tyler,et al.  One Eye is Usually Centred Horizontally (and near the Golden Section Vertically) in Portraits over the Past 500 Years , 1997 .

[14]  H. Nothdurft.  Attention shifts to salient targets , 2002, Vision Research.

[15]  Miguel P Eckstein,et al.  Classification images: a tool to analyze visual strategies. , 2002, Journal of vision.

[16]  D. Ringach,et al.  Tuning of orientation detectors in human vision , 1998, Vision Research.

[17]  H. Spitzer,et al.  Increased attention enhances both behavioral and neuronal performance. , 1988, Science.

[18]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[19]  L N Piotrowski,et al.  A Demonstration of the Visual Importance and Flexibility of Spatial-Frequency Amplitude and Phase , 1982, Perception.

[20]  M. A. Steinmetz,et al.  Neuronal responses in area 7a to multiple-stimulus displays: I. neurons encode the location of the salient stimulus. , 2001, Cerebral cortex.

[21]  J Gille,et al.  Simultaneous visual detection and identification: theory and data. , 1982, Journal of the Optical Society of America.

[22]  D. Bouwhuis,et al.  Attention and performance X : control of language processes , 1986 .

[23]  B Julesz,et al.  "Where" and "what" in vision. , 1985, Science.

[24]  Zhaoping Li.  A saliency map in primary visual cortex , 2002, Trends in Cognitive Sciences.

[25]  H. Spekreijse,et al.  Two distinct modes of sensory processing observed in monkey primary visual cortex (V1) , 2001, Nature Neuroscience.

[26]  D G Pelli,et al.  Uncertainty explains many aspects of visual contrast detection and discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[27]  Pieter R. Roelfsema,et al.  Object-based attention in the primary visual cortex of the macaque monkey , 1998, Nature.

[28]  D. Robinson,et al.  Shared neural control of attentional shifts and eye movements , 1996, Nature.

[29]  Miguel P Eckstein,et al.  Classification image analysis: estimation and statistical inference for two-alternative forced-choice experiments. , 2002, Journal of vision.

[30]  Richard B Buxton,et al.  Putting spatial attention on the map: timing and localization of stimulus selection processes in striate and extrastriate visual areas , 2001, Vision Research.

[31]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[32]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[33]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[34]  H. Nothdurft,et al.  Cueing and pop-out , 1999, Vision Research.

[35]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[36]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.