Combining 1-D components to extract pattern information: It is about more than component similarity

At least under some conditions, plaid stimuli are processed by combining information first extracted in orientation and scale-selective channels. The rules that govern this combination across channels are only partially understood. Although the available data suggests that only components having similar spatial frequency and contrast are combined, the extent to which this holds has not been firmly established. To address this question, we measured, in human subjects, the short-latency reflexive vergence eye movements induced by stereo plaids in which spatial frequency and contrast of the components are independently varied. We found that, although similarity in component spatial frequency and contrast matter, they interact in a nonseparable way. One way in which this relationship might arise is if the internal estimate of contrast is not a faithful representation of stimulus contrast but is instead spatial frequency–dependent (with higher spatial frequencies being boosted). We propose that such weighting might have been put in place by a mechanism that, in an effort of achieve contrast constancy and/or coding efficiency, regulates the gain of detectors in early visual cortex to equalize their long-term average response to natural images.

[1]  D. Burr,et al.  Functional implications of cross-orientation inhibition of cortical visual cells. I. Neurophysiological evidence , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  D. Field,et al.  What's constant in contrast constancy? The effects of scaling on the perceived contrast of bandpass patterns , 1995, Vision Research.

[3]  R Hilz,et al.  Functional organization of the peripheral retina: sensitivity to periodic stimuli. , 1974, Vision research.

[4]  Donatella Spinelli,et al.  Electrophysiological evidence for spatial frequency selective mechanisms in adults and infants , 1983, Vision Research.

[5]  D. G. Green,et al.  Optical and retinal factors affecting visual resolution. , 1965, The Journal of physiology.

[6]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[7]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[8]  D. G. Albrecht,et al.  Striate cortex responses to periodic patterns with and without the fundamental harmonics , 1981, The Journal of physiology.

[9]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[10]  M. Georgeson,et al.  Contrast constancy: deblurring in human vision by spatial frequency channels. , 1975, The Journal of physiology.

[11]  Nicholas J. Priebe,et al.  Tuning for Spatiotemporal Frequency and Speed in Directionally Selective Neurons of Macaque Striate Cortex , 2006, The Journal of Neuroscience.

[12]  Daniel J. Graham,et al.  Can the theory of “whitening” explain the center-surround properties of retinal ganglion cell receptive fields? , 2006, Vision Research.

[13]  I. Ohzawa,et al.  Organization of suppression in receptive fields of neurons in cat visual cortex. , 1992, Journal of neurophysiology.

[14]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[15]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[16]  H. Wilson,et al.  Spatial frequency tuning of orientation selective units estimated by oblique masking , 1983, Vision Research.

[17]  Mark A. Georgeson,et al.  Comparison of contrast responses across spatial mechanisms , 1988, Vision Research.

[18]  Byron Boots,et al.  Evolution of visually guided behavior in artificial agents , 2007, Network.

[19]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[20]  N. Graham Visual Pattern Analyzers , 1989 .

[21]  J. Kulikowski,et al.  Effective contrast constancy and linearity of contrast sensation , 1976, Vision Research.

[22]  C. Busettini,et al.  A role for stereoscopic depth cues in the rapid visual stabilization of the eyes , 1996, Nature.

[23]  D. O. Bowker,et al.  Suprathreshold spatiotemporal response characteristics of the human visual system. , 1983, Journal of the Optical Society of America.

[24]  J. Movshon,et al.  Spatial and temporal contrast sensitivity of neurones in areas 17 and 18 of the cat's visual cortex. , 1978, The Journal of physiology.

[25]  D. Tolhurst Adaptation to square‐wave gratings: inhibition between spatial frequency channels in the human visual system , 1972, The Journal of physiology.

[26]  D. Burr,et al.  Receptive field size of human motion detection units , 1987, Vision Research.

[27]  F. A. Miles,et al.  Short-latency disparity vergence eye movements: A response to disparity energy , 2006, Vision Research.

[28]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[29]  D J Field,et al.  Local Contrast in Natural Images: Normalisation and Coding Efficiency , 2000, Perception.

[30]  O. Bryngdahl,et al.  Characteristics of the visual system. Psychophysical measurements of the response to spatial sine-wave stimuli in the photopic region. , 1966, Journal of the Optical Society of America.

[31]  K. D. De Valois,et al.  Spatial‐frequency‐specific inhibition in cat striate cortex cells. , 1983, The Journal of physiology.

[32]  P. O. Bishop,et al.  Linear analysis of the responses of simple cells in the cat visual cortex , 2004, Experimental Brain Research.

[33]  F. A. Miles,et al.  The initial disparity vergence elicited with single and dual grating stimuli in monkeys: evidence for disparity energy sensing and nonlinear interactions. , 2008, Journal of neurophysiology.

[34]  Bart Farell,et al.  Two-dimensional matches from one-dimensional stimulus components in human stereopsis , 1998, Nature.

[35]  D. Field,et al.  Visual sensitivity, blur and the sources of variability in the amplitude spectra of natural scenes , 1997, Vision Research.

[36]  A J Knoek van Soest,et al.  The merits of a parallel genetic algorithm in solving hard optimization problems. , 2003, Journal of biomechanical engineering.

[37]  Christian Quaia,et al.  A Motion-from-Form Mechanism Contributes to Extracting Pattern Motion from Plaids , 2016, The Journal of Neuroscience.

[38]  C. F. Stromeyer,et al.  Low spatial-frequency channels in human vision: Adaptation and masking , 1982, Vision Research.

[39]  C. Blakemore,et al.  Stimulus specificity in the human visual system. , 1973, Vision research.

[40]  Mark E. McCourt,et al.  Spatial frequency interference on grating-induction , 1985, Vision Research.

[41]  J P Thomas,et al.  Detection and discrimination of simple and complex patterns at low spatial frequencies , 1977, Vision Research.

[42]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[43]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .

[44]  A. Watanabe,et al.  Spatial sine-wave responses of the human visual system. , 1968, Vision research.

[45]  David C. Burr,et al.  Receptive field properties of human motion detector units inferred from spatial frequency masking , 1989, Vision Research.

[46]  Christian Quaia,et al.  Temporal Evolution of Pattern Disparity Processing in Humans , 2013, The Journal of Neuroscience.

[47]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[48]  M S Banks,et al.  The development of contrast constancy. , 1985, Journal of experimental child psychology.

[49]  D. Burr,et al.  Spatial and temporal selectivity of the human motion detection system , 1985, Vision Research.

[50]  David J. Field,et al.  Wavelets, vision and the statistics of natural scenes , 1999, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[51]  J Anthony Movshon,et al.  Properties of pattern and component direction-selective cells in area MT of the macaque. , 2016, Journal of neurophysiology.

[52]  H. Collewijn,et al.  Precise recording of human eye movements , 1975, Vision Research.

[53]  D. G. Green,et al.  Contrast sensitivity of the human peripheral retina. , 1969, Vision research.