A neural population model for visual pattern detection.

Pattern detection is the bedrock of modern vision science. Nearly half a century ago, psychophysicists advocated a quantitative theoretical framework that connected visual pattern detection with its neurophysiological underpinnings. In this theory, neurons in primary visual cortex constitute linear and independent visual channels whose output is linked to choice behavior in detection tasks via simple read-out mechanisms. This model has proven remarkably successful in accounting for threshold vision. It is fundamentally at odds, however, with current knowledge about the neurophysiological underpinnings of pattern vision. In addition, the principles put forward in the model fail to generalize to suprathreshold vision or perceptual tasks other than detection. We propose an alternative theory of detection in which perceptual decisions develop from maximum-likelihood decoding of a neurophysiologically inspired model of population activity in primary visual cortex. We demonstrate that this theory explains a broad range of classic detection results. With a single set of parameters, our model can account for several summation, adaptation, and uncertainty effects, thereby offering a new theoretical interpretation for the vast psychophysical literature on pattern detection.

[1]  T. Meese,et al.  Zero-dimensional noise: the best mask you never saw. , 2012, Journal of vision.

[2]  A. Pouget,et al.  Not Noisy, Just Wrong: The Role of Suboptimal Inference in Behavioral Variability , 2012, Neuron.

[3]  Johan Wagemans,et al.  A New Perceptual Bias Reveals Suboptimal Population Decoding of Sensory Responses , 2012, PLoS Comput. Biol..

[4]  Yaniv Morgenstern,et al.  Local Visual Energy Mechanisms Revealed by Detection of Global Patterns , 2012, The Journal of Neuroscience.

[5]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[6]  Christopher R Fetsch,et al.  Neural correlates of reliability-based cue weighting during multisensory integration , 2011, Nature Neuroscience.

[7]  Adam N. Sanborn,et al.  Optimal decisions for contrast discrimination. , 2011, Journal of vision.

[8]  Norma V. Graham,et al.  Beyond multiple pattern analyzers modeled as linear filters (as classical V1 simple cells): Useful additions of the last 25 years , 2011, Vision Research.

[9]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[10]  Eero P. Simoncelli,et al.  Cardinal rules: Visual orientation perception reflects knowledge of environmental statistics , 2011, Nature Neuroscience.

[11]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[12]  Bruce Cumming,et al.  Correlations between the activity of sensory neurons and behavior: how much do they tell us about a neuron's causality? , 2010, Current Opinion in Neurobiology.

[13]  Jakob H Macke,et al.  Estimating predictive stimulus features from psychophysical data: The decision image technique applied to human faces. , 2010, Journal of vision.

[14]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[15]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[16]  Dennis M Levi,et al.  Stochastic model for detection of signals in noise. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  S. Solomon,et al.  Contrast sensitivity in natural scenes depends on edge as well as spatial frequency structure. , 2009, Journal of vision.

[18]  Robbe L. T. Goris,et al.  A neurophysiologically plausible population code model for human contrast discrimination. , 2009, Journal of vision.

[19]  W. Newsome,et al.  Estimates of the Contribution of Single Neurons to Perception Depend on Timescale and Noise Correlation , 2009, The Journal of Neuroscience.

[20]  H. Barlow,et al.  Single Units and Sensation: A Neuron Doctrine for Perceptual Psychology? , 1972, Perception.

[21]  Johan Wagemans,et al.  Modelling contrast discrimination data suggest both the pedestal effect and stochastic resonance to be caused by the same mechanism. , 2008, Journal of vision.

[22]  Robbe L. T. Goris,et al.  Some observations on contrast detection in noise. , 2008, Journal of vision.

[23]  W. Geisler Visual perception and the statistical properties of natural scenes. , 2008, Annual review of psychology.

[24]  L. Maloney,et al.  Perceptual organization and neural computation. , 2008, Journal of vision.

[25]  C. Law,et al.  Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area , 2008, Nature Neuroscience.

[26]  B. Dosher,et al.  Characterizing observers using external noise and observer models: assessing internal representations with external noise. , 2008, Psychological review.

[27]  E. Seidemann,et al.  Linking Neuronal and Behavioral Performance in a Reaction-Time Visual Detection Task , 2007, The Journal of Neuroscience.

[28]  A. Kohn Visual adaptation: physiology, mechanisms, and functional benefits. , 2007, Journal of neurophysiology.

[29]  Nicholas J. Priebe,et al.  The Emergence of Contrast-Invariant Orientation Tuning in Simple Cells of Cat Visual Cortex , 2007, Neuron.

[30]  G. Henning,et al.  Some observations on the pedestal effect. , 2007, Journal of vision.

[31]  Martin Rehn,et al.  A network that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fields , 2007, Journal of Computational Neuroscience.

[32]  E. Seidemann,et al.  Optimal decoding of correlated neural population responses in the primate visual cortex , 2006, Nature Neuroscience.

[33]  Debbie Y. Dao,et al.  Adaptation to sine-wave gratings selectively reduces the contrast gain of the adapted stimuli. , 2006, Journal of vision.

[34]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[35]  D. Tolhurst,et al.  Does a Bayesian model of V1 contrast coding offer a neurophysiological account of human contrast discrimination? , 2005, Vision Research.

[36]  B. Dosher,et al.  The dynamics of perceptual learning: an incremental reweighting model. , 2005, Psychological review.

[37]  M. A. Smith,et al.  Stimulus Dependence of Neuronal Correlation in Primary Visual Cortex of the Macaque , 2005, The Journal of Neuroscience.

[38]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[39]  D. Bradley,et al.  Neural population code for fine perceptual decisions in area MT , 2005, Nature Neuroscience.

[40]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[41]  P. Lennie,et al.  Profound Contrast Adaptation Early in the Visual Pathway , 2004, Neuron.

[42]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[43]  A. Parker,et al.  Neuronal activity and its links with the perception of multi-stable figures. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[44]  F A Wichmann,et al.  Contrast discrimination with sinusoidal gratings of different spatial frequency. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[45]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[46]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[47]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[48]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[49]  Pascal Mamassian,et al.  Interaction of visual prior constraints , 2001, Vision Research.

[50]  Felix Wichmann,et al.  The psychometric function: I , 2001 .

[51]  C Koch,et al.  Revisiting spatial vision: toward a unifying model. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[52]  Maria V. Sanchez-Vives,et al.  Membrane Mechanisms Underlying Contrast Adaptation in Cat Area 17In Vivo , 2000, The Journal of Neuroscience.

[53]  Felix A. Wichmann,et al.  Some Aspects of Modelling Human Spatial Vision: Contrast Discrimination , 1999 .

[54]  C. Koch,et al.  Attention activates winner-take-all competition among visual filters , 1999, Nature Neuroscience.

[55]  Z L Lu,et al.  Perceptual learning reflects external noise filtering and internal noise reduction through channel reweighting. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[56]  J. Movshon,et al.  Pattern adaptation and cross-orientation interactions in the primary visual cortex , 1998, Neuropharmacology.

[57]  K. T. Blackwell,et al.  The effect of white and filtered noise on contrast detection thresholds , 1998, Vision Research.

[58]  A. Parker,et al.  Sense and the single neuron: probing the physiology of perception. , 1998, Annual review of neuroscience.

[59]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[60]  D. G. Albrecht,et al.  Visual cortex neurons in monkeys and cats: Detection, discrimination, and identification , 1997, Visual Neuroscience.

[61]  M P Eckstein,et al.  Visual signal detection in structured backgrounds. II. Effects of contrast gain control, background variations, and white noise. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[62]  M. Carandini,et al.  A tonic hyperpolarization underlying contrast adaptation in cat visual cortex. , 1997, Science.

[63]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[64]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[65]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[66]  D. G. Albrecht,et al.  Bayesian analysis of identification performance in monkey visual cortex: Nonlinear mechanisms and stimulus certainty , 1995, Vision Research.

[67]  Jyrki Rovamo,et al.  Modelling the increase of contrast sensitivity with grating area and exposure time , 1995, Vision Research.

[68]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[69]  J. M. Foley,et al.  Human luminance pattern-vision mechanisms: masking experiments require a new model. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[70]  D. Heeger Half-squaring in responses of cat striate cells , 1992, Visual Neuroscience.

[71]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[72]  Norma Graham Breaking the Visual Stimulus Into Parts , 1992 .

[73]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[74]  N. Graham Visual Pattern Analyzers , 1989 .

[75]  G. Henning,et al.  Spatial-frequency tuning as a function of temporal frequency and stimulus motion. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[76]  A. Gorea,et al.  New look at Bloch's law for contrast. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[77]  D G Pelli,et al.  Uncertainty explains many aspects of visual contrast detection and discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[78]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[79]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[80]  P Kramer,et al.  Uncertainty about spatial frequency, spatial position, or contrast of visual patterns , 1983, Perception & psychophysics.

[81]  N. Graham,et al.  Spatial frequency uncertainty effects in the detection of sinusoidal gratings , 1981, Vision Research.

[82]  E T Davis,et al.  Allocation of attention: Uncertainty effects when monitoring one or two visual gratings of noncontiguous spatial frequencies , 1981, Perception & psychophysics.

[83]  C. F. Stromeyer,et al.  On inhibition between spatial frequency channels: Adaptation to complex gratings , 1980, Vision Research.

[84]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[85]  P. Lennie,et al.  Pattern-selective adaptation in visual cortical neurones , 1979, Nature.

[86]  G. Legge Sustained and transient mechanisms in human vision: Temporal and spatial properties , 1978, Vision Research.

[87]  J. Movshon,et al.  Spatial summation in the receptive fields of simple cells in the cat's striate cortex. , 1978, The Journal of physiology.

[88]  J. Movshon,et al.  Receptive field organization of complex cells in the cat's striate cortex. , 1978, The Journal of physiology.

[89]  S. Klein,et al.  Evidence against narrow-band spatial frequency channels in human vision: the detectability of frequency modulated gratings , 1975, Vision Research.

[90]  J Nachmias,et al.  Letter: Grating contrast: discrimination may be better than detection. , 1974, Vision research.

[91]  A Vassilev,et al.  Adaptation to square-wave gratings: in search of the elusive third harmonic. , 1973, Vision research.

[92]  D. Tolhurst Adaptation to square‐wave gratings: inhibition between spatial frequency channels in the human visual system , 1972, The Journal of physiology.

[93]  H B Barlow,et al.  Single units and sensation: a neuron doctrine for perceptual psychology? , 1972, Perception.

[94]  J. Robson,et al.  Spatial-frequency channels in human vision. , 1971, Journal of the Optical Society of America.

[95]  N. Graham,et al.  Detection of grating patterns containing two spatial frequencies: a comparison of single-channel and multiple-channels models. , 1971, Vision research.

[96]  F. Campbell,et al.  Visibility of aperiodic patterns compared with that of sinusoidal gratings , 1969, The Journal of physiology.

[97]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[98]  A Pantle,et al.  Size-Detecting Mechanisms in Human Vision , 1968, Science.

[99]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[100]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[101]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[102]  N. Nagaraja,et al.  Effect of Luminance Noise on Contrast Thresholds , 1964 .

[103]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[104]  D. Hubel Single unit activity in striate cortex of unrestrained cats , 1959, The Journal of physiology.

[105]  T. Marill Detection theory and psychophysics , 1956 .

[106]  J. Swets,et al.  A decision-making theory of visual detection. , 1954, Psychological review.