Complex 3D General Object Reconstruction from Line Drawings

An important topic in computer vision is 3D object reconstruction from line drawings. Previous algorithms either deal with simple general objects or are limited to only manifolds (a subset of solids). In this paper, we propose a novel approach to 3D reconstruction of complex general objects, including manifolds, non-manifold solids, and nonsolids. Through developing some 3D object properties, we use the degree of freedom of objects to decompose a complex line drawing into multiple simpler line drawings that represent meaningful building blocks of a complex object. After 3D objects are reconstructed from the decomposed line drawings, they are merged to form a complex object from their touching faces, edges, and vertices. Our experiments show a number of reconstruction examples from both complex line drawings and images with line drawings superimposed. Comparisons are also given to indicate that our algorithm can deal with much more complex line drawings of general objects than previous algorithms.

[1]  Hod Lipson,et al.  Identification of Faces in a 2D Line Drawing Projection of a Wireframe Object , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Ramakant Nevatia,et al.  Shape from Contour: Straight Homogeneous Generalized Cylinders and Constant Cross Section Generalized Cylinders , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Xiaoou Tang,et al.  Example-based 3D object reconstruction from line drawings , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  K. Sugihara Machine interpretation of line drawings , 1986, MIT Press series in artificial intelligence.

[5]  M. B. Clowes,et al.  On Seeing Things , 1971, Artif. Intell..

[6]  Jianzhuang Liu,et al.  Identifying Faces in a 2D Line Drawing Representing a Manifold Object , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[8]  Alasdair Turner,et al.  Sketching space , 2000, Comput. Graph..

[9]  Martin A. Fischler,et al.  An optimization-based approach to the interpretation of single line drawings as 3D wire frames , 1992, International Journal of Computer Vision.

[10]  Camillo J. Taylor,et al.  Reconstruction of linearly parameterized models from single images with a camera of unknown focal length , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[11]  Xiaoou Tang,et al.  Evolutionary Search for Faces from Line Drawings , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Zhenguo Li,et al.  Plane-Based Optimization for 3D Object Reconstruction from Single Line Drawings , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Patric R. J. Östergård,et al.  A New Algorithm for the Maximum-Weight Clique Problem , 1999, Electron. Notes Discret. Math..

[14]  Hod Lipson,et al.  Optimization-based reconstruction of a 3D object from a single freehand line drawing , 1996, Comput. Aided Des..

[15]  Yu Chen,et al.  Decomposition of Complex Line Drawings with Hidden Lines for 3D Planar-Faced Manifold Object Reconstruction , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Thomas Marill,et al.  Emulating the human interpretation of line-drawings as three-dimensional objects , 1991, International Journal of Computer Vision.

[17]  Jean Ponce,et al.  Recovering the shape of polyhedra using line-drawing analysis and complex reflectance models , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Donald E. LaCourse Handbook of solid modeling , 1995 .

[19]  Hisashi Shimodaira,et al.  A shape-from-shading method of polyhedral objects using prior information , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Kenji Shoji,et al.  3-D interpretation of single line drawings based on entropy minimization principle , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.