A method for analyzing the dimensions of preattentive visual sensitivity

Abstract A fundamental question in vision science is: Which physical differences in the visual input are spontaneously visible and which are not? At present this question has only been partially answered. We propose that spontaneously visible variations are coded in “field-capture channels” that compute statistics on the raw visual input and pass them on to higher level processes. We describe a psychophysical method for exhaustively deriving the sensitivities of perceptually-available field-capture channels and thereby determining the dimensionality of early visual processes. The description of the field-capture channels resident in human vision will take the form of a compendium of dimensions of preattentive visual sensitivity. Here we demonstrate a method for deriving this compendium. In particular, we apply the method in a domain of physical variation (textures defined by randomly scrambled mixtures of different gray levels) for which the experimental data are available. A simulation shows that the method can (1) determine the number of field-capture channels that are differentially sensitive to variations in the domain and (2) derive a set of basis functions of the space of physical variations to which those channels are sensitive.

[1]  J. Bergen,et al.  Computational Modeling of Visual Texture Segregation , 1991 .

[2]  Charles Chubb,et al.  Variance of high contrast textures is sensed using negative half-wave rectification , 2000, Vision Research.

[3]  S Grossberg,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985, Perception & psychophysics.

[4]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[5]  B. Julesz,et al.  Human factors and behavioral science: Textons, the fundamental elements in preattentive vision and perception of textures , 1983, The Bell System Technical Journal.

[6]  Jacob Beck,et al.  Spatial frequency channels and perceptual grouping in texture segregation , 1987, Comput. Vis. Graph. Image Process..

[7]  Irwin Pollack,et al.  Visual discrimination thresholds for one- and two-dimensional Markov spatial constraints , 1972 .

[8]  Hans Knutsson,et al.  Texture Analysis Using Two-Dimensional Quadrature Filters , 1983 .

[9]  MumfordDavid,et al.  Filters, Random Fields and Maximum Entropy (FRAME) , 1998 .

[10]  A. Rosenfeld,et al.  A Theory of Textural Segmentation , 1983 .

[11]  N. Suga,et al.  Criticisms of 'Specific long-term memory traces in primary auditory cortex' , 2004, Nature Reviews Neuroscience.

[12]  C. Chubb,et al.  Attentional control of texture orientation judgments , 2002, Vision Research.

[13]  Chubb,et al.  Texture-Based Methods for Analyzing Elementary Visual Substances. , 1999, Journal of mathematical psychology.

[14]  Michael S. Landy,et al.  Complex Channels, Early Local Nonlinearities, and Normalization in Texture Segregation , 1991 .

[15]  M. Landy,et al.  Histogram contrast analysis and the visual segregation of IID textures. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Norma Graham,et al.  Nonlinear processes in spatial-frequency channel models of perceived texture segregation: Effects of sign and amount of contrast , 1992, Vision Research.

[17]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[18]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  M. Landy,et al.  A visual mechanism tuned to black , 2004, Vision Research.

[20]  J. Maxwell,et al.  The Scientific Papers of James Clerk Maxwell: Experiments on Colour as perceived by the Eye, with remarks on Colour-Blindness , 2011 .

[21]  J. Beck.  Perceptual Grouping Produced by Changes in Orientation and Shape , 1966, Science.

[22]  H R Wilson.  Nonlinear processes in visual pattern discrimination. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[23]  D. Freedman,et al.  On the statistics of vision: The Julesz conjecture☆ , 1981 .

[24]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[25]  D. Sagi,et al.  Gabor filters as texture discriminator , 1989, Biological Cybernetics.

[26]  R. Browse,et al.  Asymmetries in visual texture discrimination. , 1989, Spatial vision.

[27]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[28]  I. Pollack.  Discrimination of third-order Markov constraints within visual displays , 1973 .

[29]  Song-Chun Zhu,et al.  Filters, Random Fields and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling , 1998, International Journal of Computer Vision.

[30]  B Julesz,et al.  Inability of Humans to Discriminate between Visual Textures That Agree in Second-Order Statistics—Revisited , 1973, Perception.

[31]  B. Julesz.  Textons, the elements of texture perception, and their interactions , 1981, Nature.

[32]  B. Julesz,et al.  Visual discrimination of textures with identical third-order statistics , 1978, Biological Cybernetics.

[33]  B Julesz,et al.  Experiments in the visual perception of texture. , 1975, Scientific American.

[34]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[35]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[36]  K. M. L. Suxena,et al.  Introduction to Statistical Theory , 1976 .

[37]  I. Pollack.  Detection of one-, two-, and three-dimensional Markov constraints in visual displays , 1971 .

[38]  J. Bergen,et al.  Texture segregation and orientation gradient , 1991, Vision Research.

[39]  Ennio Mingolla,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985 .

[40]  Lynn A. Olzak,et al.  Spatial frequency matching in complex stimuli (A) , 1986 .

[41]  Charles Chubb,et al.  Texture luminance judgments are approximately veridical , 2000, Vision Research.

[42]  G. Bellala,et al.  Parametric Texture Model based on Joint Statistics , 2009 .

[43]  Irwin Pollackt.  Perception of two-dimensional Markov constraints within visual displays , 1971 .

[44]  T. Caelli.  Three processing characteristics of visual texture segmentation. , 1985, Spatial vision.

[45]  J. Maxwell,et al.  The Scientific Papers of James Clerk Maxwell: Experiments on Colour as perceived by the Eye, with remarks on Colour-Blindness , 2011 .

[46]  N. Graham.  Visual Pattern Analyzers , 1989 .

[47]  George Sperling,et al.  The three dimensions of human visual sensitivity to first-order contrast statistics , 2007, Vision Research.

[48]  Béla Julesz,et al.  Visual Pattern Discrimination , 1962, IRE Trans. Inf. Theory.

[49]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.