Hue geometry and horizontal connections

Primate visual systems support an elaborate specialization for processing color information. Concentrating on the hue component, we observe that, contrary to Mondrian-like assumptions, hue varies in a smooth manner for ecologically important natural imagery. To represent these smooth variations, and to support those information processing tasks that utilize hue, a piecewise smooth hue field is postulated. The geometry of hue-patch interactions is developed analogously to orientation-patch interactions in texture. The result is a model for long-range (horizontal) interactions in the color domain, the power of which is demonstrated on a number of examples. Implications for computer image processing, computer vision, visual neurophysiology and psychophysics are discussed.

[1]  Reiner Lenz,et al.  On Color Edge Detection , 2000, PICS.

[2]  Ohad Ben-Shahar,et al.  Geometrical Computations Explain Projection Patterns of Long-Range Horizontal Connections in Visual Cortex , 2004, Neural Computation.

[3]  H. C. Nothdurft,et al.  Texture segmentation and pop-out from orientation contrast , 1991, Vision Research.

[4]  J. Rieger,et al.  Sensory and cognitive contributions of color to the recognition of natural scenes , 2000, Current Biology.

[5]  Steven W. Zucker,et al.  How Folds Cut a Scene , 2001, IWVF.

[6]  C. R. Michael,et al.  Columnar organization of color cells in monkey's striate cortex. , 1981, Journal of neurophysiology.

[7]  H. Komatsu.  Mechanisms of central color vision , 1998, Current Opinion in Neurobiology.

[8]  Brian V. Funt,et al.  Is Machine Colour Constancy Good Enough? , 1998, ECCV.

[9]  Ohad Ben-Shahar,et al.  The Perceptual Organization of Texture Flow: A Contextual Inference Approach , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[11]  Guillermo Sapiro,et al.  Anisotropic diffusion of multivalued images with applications to color filtering , 1996, IEEE Trans. Image Process..

[12]  L. Finkel,et al.  Color-opponent receptive fields derived from independent component analysis of natural images , 2000, Vision Research.

[13]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[14]  E. Land.  The retinex theory of color vision. , 1977, Scientific American.

[15]  Glenn Healey,et al.  Segmenting images using normalized color , 1992, IEEE Trans. Syst. Man Cybern..

[16]  D. Kiper,et al.  Chromatic properties of neurons in macaque area V2 , 1997, Visual Neuroscience.

[17]  Daniel Osorio,et al.  EVOLUTION AND FUNCTION OF ROUTINE TRICHROMATIC VISION IN PRIMATES , 2003, Evolution; international journal of organic evolution.

[18]  N. Dominy,et al.  Ecological importance of trichromatic vision to primates , 2001, Nature.

[19]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[20]  Steven W. Zucker,et al.  On the Foundations of Relaxation Labeling Processes , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  C. Redies,et al.  The neon color effect in the ehrenstein pattern Dependence on wavelength and illuminance , 1984, Vision Research.

[22]  D. Ts'o,et al.  The organization of chromatic and spatial interactions in the primate striate cortex , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  J. Albers,et al.  Interaction of Color , 1971 .

[24]  L. Spillmann,et al.  The Neon Color Effect in the Ehrenstein Illusion , 1981, Perception.

[25]  A. Wallace.  The Colour Sense: its Origin and Development An Essay in Comparative Psychology , 1879, Nature.

[26]  J. Beck.  Surface color perception , 1972 .

[27]  Joachim Weickert,et al.  A Review of Nonlinear Diffusion Filtering , 1997, Scale-Space.

[28]  L. Spillmann,et al.  Visual Perception: The Neurophysiological Foundations , 1989 .

[29]  Steven W. Zucker,et al.  Shadows and shading flow fields , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  J D Mollon,et al.  Chromaticity as a signal of ripeness in fruits taken by primates. , 2000, The Journal of experimental biology.

[31]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  T. Wiesel,et al.  Relationships between horizontal interactions and functional architecture in cat striate cortex as revealed by cross-correlation analysis , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  D. Hubel,et al.  Specificity of intrinsic connections in primate primary visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  J. Bergen,et al.  Texture segregation and orientation gradient , 1991, Vision Research.

[35]  A. Pressley.  Elementary Differential Geometry , 2000 .

[36]  Robert Shapley,et al.  Neural mechanisms for color perception in the primary visual cortex , 2002, Current Opinion in Neurobiology.

[37]  Guillermo Sapiro,et al.  Diffusion of General Data on Non-Flat Manifolds via Harmonic Maps Theory: The Direction Diffusion Case , 2000, International Journal of Computer Vision.

[38]  Anthony J. Yezzi,et al.  Modified curvature motion for image smoothing and enhancement , 1998, IEEE Trans. Image Process..

[39]  Ione Fine,et al.  Surface segmentation based on the luminance and color statistics of natural scenes. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[40]  Ron Kimmel,et al.  Orientation Diffusion or How to Comb a Porcupine , 2002, J. Vis. Commun. Image Represent..

[41]  J D Mollon,et al.  Catarrhine photopigments are optimized for detecting targets against a foliage background. , 2000, The Journal of experimental biology.

[42]  Josef Kittler,et al.  Relaxation labelling algorithms - a review , 1986, Image Vis. Comput..

[43]  Panos E. Trahanias,et al.  Vector directional filters-a new class of multichannel image processing filters , 1993, IEEE Trans. Image Process..

[44]  G. Eichmann,et al.  Vector median filters , 1987 .

[45]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[46]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[47]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[48]  T. Kanade,et al.  Color information for region segmentation , 1980 .

[49]  Kathy T Mullen,et al.  Contour integration in color vision: a common process for the blue–yellow, red–green and luminance mechanisms? , 2000, Vision Research.

[50]  H. Komatsu,et al.  Neural selectivity for hue and saturation of colour in the primary visual cortex of the monkey , 2000, The European journal of neuroscience.

[51]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[52]  Frederick A A Kingdom,et al.  Color brings relief to human vision , 2003, Nature Neuroscience.

[53]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[54]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[55]  Daniel Osorio,et al.  EVOLUTION AND FUNCTION OF ROUTINE TRICHROMATIC VISION IN PRIMATES , 2003 .

[56]  J. Allman,et al.  Cytochrome oxidase and functional coding in primate striate cortex: a hypothesis. , 1990, Cold Spring Harbor symposia on quantitative biology.

[57]  Andrew Blake,et al.  Boundary conditions for lightness computation in Mondrian World , 1985, Comput. Vis. Graph. Image Process..

[58]  K. Mullen,et al.  How long range is contour integration in human color vision? , 2003, Visual Neuroscience.

[59]  Michael S. Langer,et al.  When Shadows Become Interreflections , 1999, International Journal of Computer Vision.

[60]  Steven W. Zucker,et al.  Efficient Simplex-Like Methods for Equilibria of Nonsymmetric Analog Networks , 1992, Neural Computation.

[61]  T. Sejnowski,et al.  Representation of Color Stimuli in Awake Macaque Primary Visual Cortex , 2003, Neuron.

[62]  Dennis M Levi,et al.  Orientation-based texture segmentation in strabismic amblyopia , 1999, Vision Research.

[63]  Ohad Ben-Shahar,et al.  On Computing Visual Flows with Boundaries: The Case of Shading and Edges , 2002, Biologically Motivated Computer Vision.

[64]  B. O'neill.  Elementary Differential Geometry , 1966 .

[65]  Ron Kimmel,et al.  Images as Embedded Maps and Minimal Surfaces: Movies, Color, Texture, and Volumetric Medical Images , 2000, International Journal of Computer Vision.

[66]  Steven W. Zucker,et al.  Computing with Self-Excitatory Cliques: A Model and an Application to Hyperacuity-Scale Computation in Visual Cortex , 1999, Neural Computation.

[67]  M Dantini,et al.  Shadows and Enlightenment , 2003 .

[68]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[69]  E. Marg.  A VISION OF THE BRAIN , 1994 .

[70]  J. Kittler,et al.  RELAXATION LABELING ALGORITHMS - A REVIEW , 1985 .

[71]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[72]  A W Roe,et al.  Specificity of color connectivity between primate V1 and V2. , 1999, Journal of neurophysiology.

[73]  Carlo Tomasi,et al.  Color edge detection with the compass operator , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[74]  Marcello Pelillo,et al.  The Dynamics of Nonlinear Relaxation Labeling Processes , 1997, Journal of Mathematical Imaging and Vision.

[75]  Ron Kimmel,et al.  A general framework for low level vision , 1998, IEEE Trans. Image Process..

[76]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[77]  Guillermo Sapiro,et al.  Color image enhancement via chromaticity diffusion , 2001, IEEE Trans. Image Process..

[78]  A. Cowey,et al.  Cortical area V4 and its role in the perception of color , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[79]  D. J. Felleman,et al.  A spatially organized representation of colour in macaque cortical area V2 , 2003, Nature.

[80]  Ohad Ben-Shahar,et al.  Sensitivity to curvatures in orientation-based texture segmentation , 2004, Vision Research.

[81]  Brian V. Funt,et al.  Color Constancy for Scenes with Varying Illumination , 1997, Comput. Vis. Image Underst..

[82]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[83]  Guner S. Robinson.  Color Edge Detection , 1977 .

[84]  T. W. Lee,et al.  Chromatic structure of natural scenes. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[85]  Steven W. Zucker,et al.  Finding folds: on the appearance and identification of occlusion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.