Finding Boundaries in Images

In computational vision, finding the boundaries of the regions in a image which correspond to different surfaces in the scene is usually approached as a problem of detecting brightness edges. In this paper, we argue that this is a limited view. Boundaries in images could be associated with differences on a number of visual attributes-brightness, color, texture, stereoscopic disparity and motion-all of which are utilized in human vision. Machine vision systems should do the same. We argue that convolution of the image with a bank of Gaussian derivative filters is a suitable common first stage for this task. We also present some new results on the problem of detecting and localizing brightness edges composed of step, peak and roof profiles.

[1]  J. Daugman Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[2]  Jacob Beck,et al.  Spatial frequency channels and perceptual grouping in texture segregation , 1987, Comput. Vis. Graph. Image Process..

[3]  P. Cavanagh,et al.  Effect of surface medium on visual search for orientation and size features , 1990 .

[4]  V. Ramachandran,et al.  Apparent movement with subjective contours. , 1973, Vision research.

[5]  Berthold K. P. Horn Understanding Image Intensities , 1977, Artif. Intell..

[6]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms , 1990 .

[7]  Thomas O. Binford,et al.  Inferring Surfaces from Images , 1981, Artif. Intell..

[8]  E. Adelson,et al.  Early vision and texture perception , 1988, Nature.

[9]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  D. Burr,et al.  Mach bands are phase dependent , 1986, Nature.

[11]  J. Beck,et al.  Contrast and spatial variables in texture segregation: Testing a simple spatial-frequency channels model , 1989, Perception & psychophysics.

[12]  Jitendra Malik,et al.  On image texture , 1988 .

[13]  O. Braddick A short-range process in apparent motion. , 1974, Vision research.

[14]  Alex Pentland,et al.  Shape Information From Shading: A Theory About Human Perception , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[15]  D. C. Van Essen,et al.  Concurrent processing streams in monkey visual cortex , 1988, Trends in Neurosciences.

[16]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Patrick Cavanagh,et al.  Interattribute apparent motion , 1989, Vision Research.

[18]  D. Burr,et al.  Evidence for edge and bar detectors in human vision , 1989, Vision Research.

[19]  R. Young GAUSSIAN DERIVATIVE THEORY OF SPATIAL VISION: ANALYSIS OF CORTICAL CELL RECEPTIVE FIELD LINE-WEIGHTING PROFILES. , 1985 .

[20]  Jean Ponce,et al.  Toward a surface primal sketch , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[21]  T. Caelli Three processing characteristics of visual texture segmentation. , 1985, Spatial vision.

[22]  T Poggio,et al.  Parallel integration of vision modules. , 1988, Science.

[23]  J. Pokorny Foundations of Cyclopean Perception , 1972 .

[24]  A. Parker,et al.  Two-dimensional spatial structure of receptive fields in monkey striate cortex. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[25]  Tomaso Poggio,et al.  Computing texture boundaries from images , 1988, Nature.

[26]  BELA JULESZ,et al.  Rapid discrimination of visual patterns , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[27]  R. Browse,et al.  Micropattern properties and presentation conditions influencing visual texture discrimination , 1987, Perception & psychophysics.

[28]  K. Nakayama,et al.  Occlusion and the solution to the aperture problem for motion , 1989, Vision Research.

[29]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[30]  P. Cavanagh,et al.  Effect of surface medium on visual search for orientation and size features. , 1990, Journal of experimental psychology. Human perception and performance.

[31]  J. Malik,et al.  Recovering Three Dimensional Shape from a Single Image of Curved Objects , 1987, IJCAI.

[32]  Michael Kass,et al.  Computing Visual Correspondence , 1983 .

[33]  J. P. Cavanagh,et al.  Reconstructing the third dimension: Interactions between color, texture, motion, binocular disparity, and shape , 1987, Comput. Vis. Graph. Image Process..

[34]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[35]  Ben Kröse Local structure analyzers as determinants of preattentive pattern discrimination , 1987 .

[36]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[37]  H. Nothdurft Sensitivity for structure gradient in texture discrimination tasks , 1985, Vision Research.

[38]  Jitendra Malik,et al.  Detecting and localizing edges composed of steps, peaks and roofs , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[39]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[40]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[41]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[42]  Berthold K. P. Horn Image Intensity Understanding , 1975 .

[43]  J. Enns,et al.  Seeing textons in context , 1986, Perception & psychophysics.

[44]  David J. Heeger,et al.  Optical flow from spatialtemporal filters , 1987 .

[45]  Anil K. Jain,et al.  A spatial filtering approach to texture analysis , 1985, Pattern Recognit. Lett..

[46]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..