Aspects of perception and computation in color vision

One of the areas which has received little attention in computer vision research is color vision. The main reason for this was technological: color digitizers and monitors were not very common, and the amount of computation and memory needed for chromatic image processing were large and expensive. This is not longer a major factor. In addition, recent studies suggest that color contributes to other visual processes, and therefore cannot be considered as a mechanism which merely adds beauty to scenes. It should be an integral part of any computer vision system, and justifies a more complex treatment. This paper reviews the main aspects of color vision, which originate from different disciplines of science. Physical concepts regarding light and reflection govern the appearance of objects. The structure of the visual system (mainly in primates) may help the construction of computational models of color vision. Psychophysical experiments are a resource of theories which can be implemented and tested as part of a vision system. The discussion in this paper includes the different facts and problems they pose, some of which are currently being explored.

[1]  Berthold K. P. Horn,et al.  Determining lightness from an image , 1974, Comput. Graph. Image Process..

[2]  John K. Tsotsos Knowledge and the visual process: Content, form and use , 1984, Pattern Recognit..

[3]  C. R. Michael Color vision mechanisms in monkey striate cortex: dual-opponent cells with concentric receptive fields. , 1978, Journal of neurophysiology.

[4]  J T Yates,et al.  Chromatic information processing in the foveal projection (area striata) of unanesthetized primate. , 1974, Vision research.

[5]  P. A. Kolers,et al.  Shape and color in apparent motion , 1976, Vision Research.

[6]  D. Jameson,et al.  An opponent-process theory of color vision. , 1957, Psychological review.

[7]  David Taenzer Physiology and Psychology of Color Vision -- A Review , 1976 .

[8]  P A Kolers,et al.  Visual construction of color is digital. , 1975, Science.

[9]  Keith Price,et al.  Picture Segmentation Using a Recursive Region Splitting Method , 1998 .

[10]  D. G. Green,et al.  Sinusoidal flicker characteristics of the color-sensitive mechanisms of the eye. , 1969, Vision research.

[11]  G. Svaetichin,et al.  Spectral response curves from single cones. , 1956, Acta physiologica Scandinavica. Supplementum.

[12]  J. Kender Saturation, Heu, And Normalized Color: Calculation, Digitization Effects, and Use. , 1976 .

[13]  R. L. Valois,et al.  Analysis of response patterns of LGN cells. , 1966, Journal of the Optical Society of America.

[14]  N. Daw Colour‐coded ganglion cells in the goldfish retina: extension of their receptive fields by means of new stimuli , 1968, The Journal of physiology.

[15]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[16]  V. Torre,et al.  The responses of amacrine cells to light and intracellularly applied currents. , 1978, The Journal of physiology.

[17]  J M Wolfe,et al.  Hidden visual processes. , 1983, Scientific American.

[18]  C. R. Ingling,et al.  Orthogonal combination of the three visual channels , 1977, Vision Research.

[19]  Manfred H. Hueckel An Operator Which Locates Edges in Digitized Pictures , 1971, J. ACM.

[20]  W. B. Marks,et al.  Visual Pigments of Single Primate Cones , 1964, Science.

[21]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[22]  K. Hoffmann,et al.  Conduction velocity in pathways from retina to superior colliculus in the cat: a correlation with receptive-field properties. , 1973, Journal of neurophysiology.

[23]  S. Zeki The representation of colours in the cerebral cortex , 1980, Nature.

[24]  C. Enroth-Cugell,et al.  The contrast sensitivity of retinal ganglion cells of the cat , 1966, The Journal of physiology.

[25]  D. Hubel,et al.  Spatial and chromatic interactions in the lateral geniculate body of the rhesus monkey. , 1966, Journal of neurophysiology.

[26]  Christopher M. Brown,et al.  Color Vision and Computer Vision , 1982 .

[27]  Robert M. Boynton,et al.  Bezold–Brücke Hue Shift Measured by Color-Naming Technique* , 1965 .

[28]  O E Favreau,et al.  Perceived velocity of moving chromatic gratings. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[29]  E. Zrenner,et al.  Color coding in primate retina , 1981, Vision Research.

[30]  S. McKee,et al.  Quantitative studies in retinex theory a comparison between theoretical predictions and observer responses to the “color mondrian” experiments , 1976, Vision Research.

[31]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[32]  E Taylor,et al.  Calculation of total retinal area. , 1971, The British journal of ophthalmology.

[33]  D. Tolhurst,et al.  Trichromatic colour opponency in ganglion cells of the rhesus monkey retina. , 1975, The Journal of physiology.

[34]  Azriel Rosenfeld,et al.  Scene segmentation by cluster detection in color spaces , 1976, SGAR.

[35]  S. W. Kuffler Discharge patterns and functional organization of mammalian retina. , 1953, Journal of neurophysiology.

[36]  C. R. Michael Color-sensitive complex cells in monkey striate cortex. , 1978, Journal of neurophysiology.

[37]  I. Abramov Further analysis of the responses of LGN cells. , 1968, Journal of the Optical Society of America.

[38]  Helga Kolb,et al.  The connections between horizontal cells and photoreceptors in the retina of the cat: Electron microscopy of Golgi preparations , 1974, The Journal of comparative neurology.

[39]  Berthold K. P. Horn Understanding Image Intensities , 1977, Artif. Intell..

[40]  Jonathan Stone,et al.  Hierarchical and parallel mechanisms in the organization of visual cortex , 1979, Brain Research Reviews.

[41]  M. P. Friedman,et al.  HANDBOOK OF PERCEPTION , 1977 .

[42]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[43]  P. Gouras Identification of cone mechanisms in monkey ganglion cells , 1968, The Journal of physiology.

[44]  J. Stone,et al.  Projection of X- and Y-cells of the cat's lateral geniculate nucleus to areas 17 and 18 of visual cortex. , 1973, Journal of neurophysiology.

[45]  W. Stell,et al.  Horizontal cell axons and axon terminals in goldfish retina , 1975, The Journal of comparative neurology.

[46]  P Cavanagh,et al.  Color and luminance: independent frequency shifts. , 1981, Science.

[47]  P. Gouras,et al.  Responses of cells in foveal visual cortex of the monkey to pure color contrast. , 1979, Journal of neurophysiology.

[48]  D H Hubel,et al.  Brain mechanisms of vision. , 1979, Scientific American.

[49]  D. H. Kelly Spatio-temporal frequency characteristics of color-vision mechanisms* , 1974 .

[50]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[51]  Jake K. Aggarwal,et al.  Segmentation of chromatic images , 1981, Pattern Recognit..

[52]  A R Smith,et al.  Color Gamut Transformation Pairs , 1978 .

[53]  C. R. Michael Color vision mechanisms in monkey striate cortex: simple cells with dual opponent-color receptive fields. , 1978, Journal of neurophysiology.

[54]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[55]  R. M. Boynton,et al.  A line, not a space, represents visual distinctness of borders formed by different colors. , 1976, Science.

[56]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.