The Interpretation of Line Drawings with Contrast Failure and Shadows

In line drawings derived from real images, lines may be missing due to contrast failure and objects with curved surfaces may cast shadows from multiple light sources.This paper shows that it is the presence of shadows, rather than contrast failure, that renders the line drawing labelling problem NP-complete. However, shadows are a valuable visual cue, since their presence is formally shown to reduce the average ambiguity of drawings. This is especially true when constraints concerning shadow formation are employed to differentiate shadow and non-shadow lines.The extended junction constraint, concerning straight lines colinear with junctions, compensates the loss of information caused by contrast failure. In fact, we observe the contrast failure paradox: a drawing is sometimes less ambiguous when lines are partly missing due to contrast failure.It is known that the coplanarity of sets of object vertices can be deduced from the presence of straight lines in the drawing. This paper shows that these coplanarity constraints are robust to the presence of contrast failure.

[1]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[2]  Kokichi Sugihara,et al.  A Necessary and Sufficient Condition for a Picture to Represent a Polyhedral Scene , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Martin C. Cooper Fundamental Properties of Neighbourhood Substitution in Constraint Satisfaction Problems , 1997, Artif. Intell..

[4]  J. M. Rubin,et al.  Color vision and image intensities: When are changes material? , 1982, Biological Cybernetics.

[5]  Martin C. Cooper Linear constraints for the interpretation of line drawings of curved objects , 2000, Artif. Intell..

[6]  Jean Ponce,et al.  Recovering the Shape of Polyhedra Using Line-Drawing Analysis and Complex Reflectance Models , 1997, Comput. Vis. Image Underst..

[7]  Eugene C. Freuder Eliminating Interchangeable Values in Constraint Satisfaction Problems , 1991, AAAI.

[8]  Kokichi Sugihara,et al.  Mathematical Structures of Line Drawings of Polyhedrons-Toward Man-Machine Communication by Means of Line Drawings , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  J. Malik,et al.  Recovering Three Dimensional Shape from a Single Image of Curved Objects , 1987, IJCAI.

[10]  Christos H. Papadimitriou,et al.  The complexity of recognizing polyhedral scenes , 1985, 26th Annual Symposium on Foundations of Computer Science (sfcs 1985).

[11]  Vishvjit S. Nalwa Line-drawing interpretation: A mathematical framework , 2004, International Journal of Computer Vision.

[12]  David Lichtenstein,et al.  Planar Formulae and Their Uses , 1982, SIAM J. Comput..

[13]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[14]  Edward P. K. Tsang,et al.  Foundations of constraint satisfaction , 1993, Computation in cognitive science.

[15]  Kurt Mehlhorn,et al.  Graph Algorithm and NP-Completeness , 1984 .

[16]  S. Sutherland Seeing things , 1989, Nature.

[17]  K. Sugihara Machine interpretation of line drawings , 1986, MIT Press series in artificial intelligence.

[18]  Josef Kittler,et al.  Vanishing point detection , 1993, Image Vis. Comput..

[19]  Martin C. Cooper Interpretation of line drawings of complex objects , 1993, Image Vis. Comput..

[20]  Martin C. Cooper Interpreting line drawings of curved objects with tangential edges and surfaces , 1997, Image Vis. Comput..

[21]  Jitendra Malik,et al.  Interpreting line drawings of curved objects , 1986, International Journal of Computer Vision.

[22]  Martin C. Cooper Linear-Time Algorithms for Testing the Realisability of Line Drawings of Curved Objects , 1999, Artif. Intell..

[23]  C. Coelho,et al.  Extraction of vanishing points from images of indoor and outdoor scenes , 1993, Image Vis. Comput..

[24]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[25]  Vincent Torre,et al.  On the Complexity of Labeling Perspective Projections of Polyhedral Scenes , 1994, Artif. Intell..