Higher level chromatic mechanisms for image segmentation.

We used a noise-masking paradigm to investigate the number and properties of chromatic mechanisms involved in image segmentation. Observers were presented with a pattern of dynamic random squares, each independently modulated along a certain direction in DKL color space, either in the isoluminant plane or in the L - M luminance plane. A signal consisting of a rectangular region of squares, oriented horizontally or vertically, was added to the noise. The signal squares were spatially and temporally aligned to the noise squares, excluding the possibility of phase offsets to mediate segmentation performance. Noise and signal color directions were independently varied, and the signal contrast was measured at which an observer could reliably indicate the orientation of the signal. In a second set of experiments, the noise was simultaneously varying in two directions, symmetrically arranged around the signal direction. Masking was generally highest when signal and noise were modulated along the same direction and minimal for orthogonal noise. No difference was found between signals modulated along cardinal directions or intermediate directions. However, measured tuning widths critically depended on the type of noise: Noise modulated along one direction results in narrow tuning, whereas two-sided noise results in broad tuning. A chromatic detection model with multiple broadly tuned mechanisms successfully accounts for the experimental findings, both for narrow and broad tuning curves. Models with four broadly tuned cardinal mechanisms or multiple narrowly tuned mechanisms failed to reproduce the data. Our results suggest an important role for multiple, broadly tuned mechanisms in image segmentation.

[1]  Colin W G Clifford,et al.  Interactions between color and luminance in the perception of orientation. , 2003, Journal of vision.

[2]  P. Lennie,et al.  Chromatic mechanisms in striate cortex of macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Qasim Zaidi,et al.  Adaptive orthogonalization of opponent-color signals , 1993, Biological Cybernetics.

[4]  David H. Brainard,et al.  Calibration of a computer controlled color monitor , 1989 .

[5]  K. D. De Valois,et al.  A multi-stage color model. , 1993, Vision research.

[6]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[7]  M D'Zmura,et al.  Mechanisms of color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[8]  T. Sejnowski,et al.  Representation of Color Stimuli in Awake Macaque Primary Visual Cortex , 2003, Neuron.

[9]  Rhea T Eskew,et al.  Chromatic masking in the (ΔL/L, ΔM/M) plane of cone-contrast space reveals only two detection mechanisms , 1998, Vision Research.

[10]  J. B. Levitt,et al.  Functional properties of neurons in macaque area V3. , 1997, Journal of neurophysiology.

[11]  Michael D'Zmura,et al.  Color in visual search , 1991, Vision Research.

[12]  H. Komatsu Mechanisms of central color vision , 1998, Current Opinion in Neurobiology.

[13]  J. Pokorny,et al.  Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm , 1975, Vision Research.

[14]  Barry B. Lee,et al.  Chapter 7 New views of primate retinal function , 1990 .

[15]  J. Mollon,et al.  A theory of theΠ1 andΠ3 color mechanisms of stiles , 1979, Vision Research.

[16]  R. M. Boynton,et al.  Chromaticity diagram showing cone excitation by stimuli of equal luminance. , 1979, Journal of the Optical Society of America.

[17]  C. F. Stromeyer,et al.  Spatial masking does not reveal mechanisms selective to combined luminance and red–green color , 1999, Vision Research.

[18]  M. Webster,et al.  Changes in colour appearance following post-receptoral adaptation , 1991, Nature.

[19]  K. Mullen,et al.  Postreceptoral chromatic detection mechanisms revealed by noise masking in three-dimensional cone contrast space. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Bart Farell,et al.  Coherence, cardinal directions and higher-order mechanisms , 1996, Vision Research.

[21]  H. Wilson,et al.  Modified line-element theory for spatial-frequency and width discrimination. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[22]  M. Webster,et al.  The influence of contrast adaptation on color appearance , 1994, Vision Research.

[23]  Angela M. Brown,et al.  Masking of grating detection in the isoluminant plane of DKL color space. , 2004, Visual neuroscience.

[24]  P. Lennie,et al.  Mechanisms Underlying Segmentation of Colored Textures , 1997, Vision Research.

[25]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[26]  Angela M. Brown,et al.  Higher order color mechanisms , 1986, Vision Research.

[27]  K. Gegenfurtner,et al.  Cortical mechanisms of colour vision , 2003, Nature Reviews Neuroscience.

[28]  Kenneth Knoblauch,et al.  Reply to Letter to Editor , 2006 .

[29]  D. Kiper,et al.  Chromatic properties of neurons in macaque area V2 , 1997, Visual Neuroscience.

[30]  R. L. Valois,et al.  A multi-stage color model , 1993, Vision Research.

[31]  D. W. Heeley,et al.  Cardinal directions of color space , 1982, Vision Research.

[32]  H. Helmholtz Helmholtz's Treatise on Physiological Optics , 1963 .

[33]  Mahito Fujii,et al.  Sensitivity to modulation of color distribution in multicolored textures , 2001, Vision Research.

[34]  K R Gegenfurtner,et al.  Contrast detection in luminance and chromatic noise. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[35]  Hans Irtel,et al.  Computing data for color-vision modeling , 1992 .

[36]  B. Wandell,et al.  Detection of long-duration, long-wavelength incremental flashes by a chromatically coded pathway , 1980, Vision Research.

[37]  D. Jameson,et al.  An opponent-process theory of color vision. , 1957, Psychological review.

[38]  Rhea T. Eskew,et al.  Chromatic detection and discrimination analyzed by a Bayesian classifier , 2001, Vision Research.

[39]  P. Lennie,et al.  Chromatic mechanisms in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[40]  Kenneth Knoblauch,et al.  Spectral bandwidths for the detection of color , 1998, Vision Research.

[41]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[42]  G. Legge,et al.  Contrast discrimination in noise. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[43]  P. Lennie,et al.  Mechanisms of color constancy: erratum , 1986 .

[44]  Scott N. J. Watamaniuk,et al.  Direction Perception in Complex Dynamic Displays: the Integration of Dir~~tion Information , 1988 .

[45]  S Yamane,et al.  Color selectivity of neurons in the inferior temporal cortex of the awake macaque monkey , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.