Perceptual completion of occluded surfaces

Researchers in computer vision have primarily studied the problem of visual reconstruction of environmental structure that is plainly visible. In this paper, the conventional goals of visual reconstruction are generalized to include both visible and occluded forward facing surfaces. This larger fraction of the environment is termed the anterior surfaces. In this paper, we show that the boundaries of the anterior surfaces can be represented in viewer-centered coordinates as a labeled knot diagram. Where boundaries are not occluded and where surface reflectance is distinct from that of the background, boundaries will be marked by image contours. However, where boundaries are occluded, or where surface reflectance matches background reflectance, there will be no detectable luminance change in the image. Deducing the complete image trace of the boundaries of the anterior surfaces under these circumstances is termed the figural completion problem. The second half of this paper describes a computational theory of figural completion. A working model is demonstrated on a variety of illusory contour displays. The experimental system employs a two stage process of completion hypothesis and combinatorial optimization. The labeling scheme is enforced by integer linear inequalities so that the optimal feasible solution of an integer linear program defines a typologically valid surface organization.<<ETX>>

[1]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[2]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[3]  Gérard G. Medioni,et al.  Inferring global perceptual contours from local features , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  D. Bobrow.  Retrospective on “Interpreting line drawings as three-dimensional surfaces” , 1994 .

[5]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[6]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[7]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[8]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[9]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[10]  Louis H. Kauffman.  Planar surface immersions , 1979 .

[11]  Allen R. Hanson,et al.  Perceptual Completion of Occluded Surfaces , 1996, Comput. Vis. Image Underst..

[12]  Berthold K. P. Horn.  The Curve of Least Energy , 1983, TOMS.

[13]  David Mumford,et al.  The 2.1-D sketch , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[14]  David W. Jacobs.  The Use of Grouping in Visual Object Recognition , 1988 .

[15]  F. Schumann.  Contributions to the Analysis of Visual Perception—First Paper: Some Observations on the Combination of Visual Impressions into Units , 1987 .

[16]  Steven W. Zucker,et al.  On the Foundations of Relaxation Labeling Processes , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  V. Ramachandran,et al.  On the perception of illusory contours , 1994, Vision Research.

[18]  S. Ullman.  The Interpretation of Visual Motion , 1979 .

[19]  W. Köhler.  The task of Gestalt psychology , 1969 .

[20]  A. Witkin,et al.  On the Role of Structure in Vision , 1983 .

[21]  Rakesh Kumar,et al.  Model-dependent inference of 3D information from a sequence of 2D images , 1992 .

[22]  Lance R. Williams,et al.  Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience , 1995, Neural Computation.

[23]  Harvey M. Salkin,et al.  Foundations of integer programming , 1989 .

[24]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[25]  Michael Henle,et al.  A combinatorial introduction to topology , 1978 .

[26]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[27]  Eric Saund.  Identifying salient circular arcs on curves , 1993 .

[28]  Leif H. Finkel,et al.  Object Discrimination Based on Depth-from-Occlusion , 1992, Neural Computation.

[29]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[30]  Lance R. Williams.  Perceptual organization of occluding contours , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[31]  Edward M. Riseman,et al.  Computing curvilinear structure by token-based grouping , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Edward M. Riseman,et al.  Token-based extraction of straight lines , 1989, IEEE Trans. Syst. Man Cybern..

[33]  Azriel Rosenfeld,et al.  Scene Labeling by Relaxation Operations , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[34]  Allan D. Jepson,et al.  From Features to Perceptual Categories , 1992, BMVC.

[35]  Philip J. Kellman,et al.  An Object Perception Approach to Static and Kinetic Subjective Contours , 1987 .

[36]  Harry G. Barrow,et al.  Retrospective on "Interpreting Line Drawings as Three-Dimensional Surfaces" , 1993, Artif. Intell..

[37]  J. Koenderink,et al.  The Shape of Smooth Objects and the Way Contours End , 1982, Perception.

[38]  Stephen Grossberg,et al.  Neural dynamics of surface perception: Boundary webs, illuminants, and shape-from-shading , 1987, Comput. Vis. Graph. Image Process..

[39]  J. Callahan.  Singularities and Plane Maps , 1974 .

[40]  On Knots , 1990, Acta Applicandae Mathematicae.

[41]  I. Rock.  The Logic of Perception , 1983 .

[42]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[43]  Rüdiger von der Heydt,et al.  A computational model of neural contour processing: Figure-ground segregation and illusory contours , 1993, 1993 (4th) International Conference on Computer Vision.

[44]  R. Hetherington.  The Perception of the Visual World , 1952 .

[45]  T. Sederberg,et al.  Comparison of three curve intersection algorithms , 1986 .

[46]  J. Gibson.  The perception of the visual world , 1951 .

[47]  Stephen Grossberg,et al.  The Role of Illusory Contours in Visual Segmentation , 1987 .