Perceptual Completion of Occluded Surfaces

Researchers in computer vision have primarily studied the problem of visual reconstruction of environmental structure that is plainly visible. In this paper, the conventional goals of visual reconstruction are generalized to include both visible and occluded forward facing surfaces. This larger fraction of the environment is termed theanterior surfaces. Because multiple anterior surface neighborhoods project onto a single image neighborhood wherever surfaces overlap, surface neighborhoods and image neighborhoods are not guaranteed to be in one-to-one correspondence, as conventional “shape-from” methods assume. The result is that the topology of three-dimensional scene structure can no longer be taken for granted, but must be inferred from evidence provided by image contours. In this paper, we show that the boundaries of the anterior surfaces can be represented in viewer-centered coordinates as alabeled knot-diagram. Where boundaries are not occluded and where surface reflectance is distinct from that of the background, boundaries will be marked by image contours. However, where boundaries are occluded, or where surface reflectance matches background reflectance, there will be no detectable luminance change in the image. Deducing the complete image trace of the boundaries of the anterior surfaces under these circumstances is called thefigural completionproblem. The second half of this paper describes a computational theory of figural completion. In more concrete terms, the problem of computing a labeled knot-diagram representing an anterior scene from a set of contour fragments representing image luminance boundaries is investigated. A working model is demonstrated on a variety of illusory contour displays. The experimental system employs a two-stage process of completion hypothesis and combinatorial optimization. The labeling scheme is enforced by a system of integer linear inequalities so that the final organization is the optimal feasible solution of an integer linear program.

[1]  Lance R. Williams,et al.  Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience , 1995, Neural Computation.

[2]  Allen R. Hanson,et al.  Perceptual completion of occluded surfaces , 1996, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  David Mumford,et al.  The 2.1-D sketch , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Gérard G. Medioni,et al.  Inferring global perceptual contours from local features , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Berthold K. P. Horn.  The Curve of Least Energy , 1983, TOMS.

[6]  Louis H. Kauffman.  Planar surface immersions , 1979 .

[7]  Philip J. Kellman,et al.  An Object Perception Approach to Static and Kinetic Subjective Contours , 1987 .

[8]  Harry G. Barrow,et al.  Retrospective on "Interpreting Line Drawings as Three-Dimensional Surfaces" , 1993, Artif. Intell..

[9]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[10]  Edward M. Riseman,et al.  Token-based extraction of straight lines , 1989, IEEE Trans. Syst. Man Cybern..

[11]  A. Witkin,et al.  On the Role of Structure in Vision , 1983 .

[12]  Leif H. Finkel,et al.  Object Discrimination Based on Depth-from-Occlusion , 1992, Neural Computation.

[13]  S. Petry,et al.  The Perception of Illusory Contours , 1987 .

[14]  J. Koenderink,et al.  The Shape of Smooth Objects and the Way Contours End , 1982, Perception.

[15]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[16]  Rüdiger von der Heydt,et al.  A computational model of neural contour processing: Figure-ground segregation and illusory contours , 1993, 1993 (4th) International Conference on Computer Vision.

[17]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[18]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[19]  I. Rock.  The Logic of Perception , 1983 .

[20]  Stephen Grossberg,et al.  Neural dynamics of surface perception: Boundary webs, illuminants, and shape-from-shading , 1987, Comput. Vis. Graph. Image Process..