An experimental investigation in the use of color in computational stereopsis

Three different models of incorporating color in computational stereopsis were investigated. The simplest model, the three-channel model, treats color as if it were composed of separate entities. Each color channel is processed individually by the same stereopsis module as used in the achromatic model. The second model, the trichromatic model, treats color as an attribute of features (i.e., edges). Matching is done by comparing these attributes. The third model, the opponent color model, is based on the human vision system. In this model, the red-green-blue colors are combined into three opponent channels before further processing. These models along with the achromatic stereopsis model were implanted and tested with many stereograms to determine the performance of different combinations of color and stereopsis. Experimental results indicate that color information increases performance, communication between color channels during matching is very important, and the overall performance of the opponent model appears to be the best. Also described is the relaxation surface smoothing algorithm, which corrects assignment errors. >

[1]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Kenneth C. Smith,et al.  Design and implementation of a colour vision model for computer vision applications , 1987 .

[3]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  W. Eric L. Grimson,et al.  Binocular shading and visual surface reconstruction , 1984, Comput. Vis. Graph. Image Process..

[5]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[6]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  Alan C. Bovik,et al.  COMPUTATIONAL STEREO USING COLOR. , 1987 .

[8]  A. Bovik,et al.  Computational stereo vision using color , 1988, IEEE Control Systems Magazine.

[9]  Alfred M. Bruckstein,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[10]  Takeo Kanade,et al.  Image Segmentation And Reflection Analysis Through Color , 1988, Defense, Security, and Sensing.

[11]  John C. Beatty,et al.  An experimental comparison of RGB, YIQ, LAB, HSV, and opponent color models , 1987, TOGS.

[12]  D. Fender,et al.  The interaction of color and luminance in stereoscopic vision. , 1972, Investigative ophthalmology.

[13]  Kim L. Boyer,et al.  Robotic Manipulation Experiments Using Structural Stereopsis for 3D Vision , 1986, IEEE Expert.

[14]  Ohyoung Song,et al.  Curvilinear feature extraction using minimum spanning trees , 1983, Comput. Vis. Graph. Image Process..

[15]  A. Waxman,et al.  Using disparity functional for stereo correspondence and surface reconstruction , 1987 .

[16]  DH Hubel,et al.  Psychophysical evidence for separate channels for the perception of form, color, movement, and depth , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[18]  Robert M. Haralick,et al.  Digital Step Edges from Zero Crossing of Second Directional Derivatives , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[20]  W. Eric L. Grimson,et al.  Surface consistency constraints in vision , 1982, Comput. Graph. Image Process..

[21]  Ewald Hering Outlines of a theory of the light sense , 1964 .

[22]  John E. W. Mayhew,et al.  Psychophysical and Computational Studies Towards a Theory of Human Stereopsis , 1981, Artif. Intell..

[23]  W. Eric L. Grimson,et al.  Computational Experiments with a Feature Based Stereo Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  R. L. Valois Color Vision Mechanisms in the Monkey , 1960 .

[25]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[26]  W. Eric L. Grimson,et al.  From images to surfaces , 1981 .

[27]  John H. R. Maunsell,et al.  Visual processing in monkey extrastriate cortex. , 1987, Annual review of neuroscience.

[28]  Gershon Buchsbaum,et al.  Information theoretic aspects of color signal processing in the visual system , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[29]  Wilson S. Geisler,et al.  CHROMATICITY AS A SOURCE OF INFORMATION IN THE HUMAN STEREO CORRESPONDENCE PROCESS. , 1987 .

[30]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[31]  Robert M. Boynton,et al.  Bezold–Brücke Hue Shift Measured by Color-Naming Technique* , 1965 .

[32]  Thomas O. Binford,et al.  Depth from Edge and Intensity Based Stereo , 1981, IJCAI.

[33]  Ramakant Nevatia,et al.  Segment-based stereo matching , 1985, Comput. Vis. Graph. Image Process..

[34]  DH Hubel,et al.  Segregation of form, color, and stereopsis in primate area 18 , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.