Seeds of Perception

Not all information is created equal. Different locations in an image (or range image) impose differing levels of constraint upon visual processes. We call locations in images (and other representations) that offer the tightest constraint seeds. We are exploring algorithms that work initially from seeds to locations of ever decreasing constraint. Thus in motion, we work from corners to edges and then to regions bounded by those edges. We recount recent progress in developing this theme in the problems of computing shape from contour, the determination of optic flow and structure from motion, and stereo. We review related work in shape from shading, and the interpretation of variable geometry planar shapes. The loci of two dimensional change that are discussed in this paper are uncovered by the programs of Fleck and Noble at this conference, as well as by Forsyth's colour labelling of edges.

[1]  Hans P. Moravec.  Towards Automatic Visual Obstacle Avoidance , 1977, IJCAI.

[2]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[3]  Larry S. Davis,et al.  Contour-based motion estimation , 1982, Comput. Vis. Graph. Image Process..

[4]  Jean Ponce,et al.  Describing surfaces , 1985, Comput. Vis. Graph. Image Process..

[5]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[6]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  A. Pentland.  The visual inference of shape : computation from local features , 1982 .

[8]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .

[9]  Michael Brady,et al.  The Curvature Primal Sketch , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Alan L. Yuille,et al.  An Extremum Principle for Shape from Contour , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Andrew Blake,et al.  Surface descriptions from stereo and shading , 1986, Image Vis. Comput..

[12]  Hans-Hellmut Nagel,et al.  Image Sequences - Ten (Octal) Years - from phenomenology towards a Theoretical Foundation , 1988, Int. J. Pattern Recognit. Artif. Intell..

[13]  Ingemar J. Cox,et al.  On Optimum Edge Recognition using Matched Filters , 1986, CVPR 1986.

[14]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[15]  Hans P. Morevec.  Towards automatic visual obstacle avoidance , 1977, IJCAI 1977.

[16]  Anna R. Bruss.  The Image Irradiance Equation: Its Solution and Application , 1981 .

[17]  Jan J. Koenderink,et al.  Local structure of movement parallax of the plane , 1976 .

[18]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Demetri Terzopoulos,et al.  The Role of Constraints and Discontinuities in Visible-Surface Reconstruction , 1983, IJCAI.

[20]  Radu Horaud,et al.  On the geometric interpretation of image contours , 1989 .

[21]  Andrew Blake,et al.  Specular Stereo , 1985, IJCAI.

[22]  Ellen C. Hildreth,et al.  Measurement of Visual Motion , 1984 .

[23]  Takeo Kanade,et al.  Recovery of the Three-Dimensional Shape of an Object from a Single View , 1981, Artif. Intell..

[24]  Richard A. Volz,et al.  Recognizing Partially Occluded Parts , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[26]  Libor Spacek,et al.  Edge detection and motion detection , 1986, Image Vis. Comput..

[27]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[28]  Thomas O. Binford,et al.  Inferring Surfaces from Images , 1981, Artif. Intell..

[29]  D. Marr,et al.  Analysis of occluding contour , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[30]  Jean Ponce,et al.  Toward a surface primal sketch , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[31]  J. Koenderink,et al.  Exterospecific component of the motion parallax field. , 1981, Journal of the Optical Society of America.

[32]  Marsha Jo Hannah,et al.  Bootstrap Stereo , 1980, AAAI.

[33]  J. Koenderink,et al.  Spatial and temporal parameters of motion detection in the peripheral visual field. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[34]  D. D. Hoffman,et al.  Representing Smooth Plane Curves for Recognition: Implications for Figure-Ground Reversal , 1982, AAAI.

[35]  Hans-Hellmut Nagel,et al.  Volumetric model and 3D trajectory of a moving car derived from monocular TV frame sequences of a street scene , 1981, Comput. Graph. Image Process..

[36]  T. N. Stevenson,et al.  Fluid Mechanics , 2021, Nature.

[37]  S. Sutherland.  Seeing things , 1989, Nature.

[38]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[39]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[40]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.