Integrating Vision Modules: Stereo, Shading, Grouping, and Line Labeling

It is generally agreed that individual visual cues are fallible and often ambiguous. This has generated a lot of interest in design of integrated vision systems which are expected to give a reliable performance in practical situations. The design of such systems is challenging since each vision module works under a different and possibly conflicting set of assumptions. We have proposed and implemented a multiresolution system which integrates perceptual organization (grouping), segmentation, stereo, shape from shading, and line labeling modules. We demonstrate the efficacy of our approach using images of several different realistic scenes. The output of the integrated system is shown to be insensitive to the constraints imposed by the individual modules. The numerical accuracy of the recovered depth is assessed in case of synthetically generated data. Finally, we have qualitatively evaluated our approach by reconstructing geons from the depth data obtained from the integrated system. These results indicate that integrated vision systems are likely to produce better reconstruction of the input scene than the individual modules. >

[1]  Andrew Blake,et al.  Surface descriptions from stereo and shading , 1986, Image Vis. Comput..

[2]  W. Eric L. Grimson,et al.  Binocular shading and visual surface reconstruction , 1984, Comput. Vis. Graph. Image Process..

[3]  H H Bülthoff,et al.  Integration of depth modules: stereo and shading. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[4]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[5]  Sharath Pankanti,et al.  On integration of vision modules , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  S. Grossberg Neural Networks and Natural Intelligence , 1988 .

[7]  E. Lehmann,et al.  Nonparametrics: Statistical Methods Based on Ranks , 1976 .

[8]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Narendra Ahuja,et al.  Extraction of early perceptual structure in dot patterns: Integrating region, boundary, and component gestalt , 1989, Comput. Vis. Graph. Image Process..

[10]  Berthold K. P. Horn Obtaining shape from shading information , 1989 .

[11]  Allan D. Jepson,et al.  A lattice framework for integrating vision modules , 1992, IEEE Trans. Syst. Man Cybern..

[12]  W. Eric L. Grimson,et al.  Finding cylinders in range data , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[13]  Kim L. Boyer,et al.  Integration, Inference, and Management of Spatial Information Using Bayesian Networks: Perceptual Organization , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Aaron F. Bobick,et al.  The direct computation of height from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Narendra Ahuja,et al.  Matching Two Perspective Views , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  J. OLIENSIS Shape from shading as a partially well-constrained problem , 1991, CVGIP Image Underst..

[17]  Anil K. Jain,et al.  Edge detection and labeling by fusion of intensity and range images , 1992, Defense, Security, and Sensing.

[18]  Shree K. Nayar,et al.  Removal of specularities using color and polarization , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[20]  H.I. Bozma,et al.  A Game-Theoretic Approach to Integration of Modules , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Mubarak Shah,et al.  Integration of shape from X modules: combining stereo and shading , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Theo Pavlidis,et al.  Algorithms for Graphics and Imag , 1983 .