A freehand sketching interface for progressive construction of 3D objects

This paper presents an intuitive, freehand sketching application for Computer Aided Design (CAD) that can reconstruct a 3D object from a single, flat, freehand sketch. A pen is used to draw 2D sketches consisting of straight and curved strokes connected at vertices. The sketches are processed by a reconstruction algorithm that uses the angular distribution of the strokes and their connectivity to determine an orthogonal 3D axis system whose projection correlates with the observed stroke orientations. The axis system is used to determine a plausible depth for each vertex. This approach works well for drawings of objects whose edges predominantly conform to some overall orthogonal axis system. A second, independent optimization procedure is then used to reconstruct each curved stroke in the original sketch, assuming that the curve is planar. New strokes can be attached to the 3D object, or drawn directly onto the object's faces. An implementation of the reconstruction algorithm based on Levenberg--Marquardt optimization allows objects with over 50 strokes to be reconstructed in interactive time.

[1]  A. Macworth.  Interpreting pictures of polyhedral scenes , 1973 .

[2]  Alan K. Mackworth.  Interpreting Pictures of Polyhedral Scenes , 1973, IJCAI.

[3]  K. Sugihara.  Machine interpretation of line drawings , 1986, MIT Press series in artificial intelligence.

[4]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[5]  Y. Fukui.  Input method of boundary solids by sketching , 1988 .

[6]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[7]  S. Sutherland.  Seeing things , 1989, Nature.

[8]  Del Lamb,et al.  Interpreting a 3D object from a rough 2D line drawing , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[9]  Weidong Wang,et al.  A Polyhedral Object's CSG-Rep Reconstruction From a Single 2D Line Drawing , 1990, Other Conferences.

[10]  E. Ferguson.  Engineering and the minds eye , 1992 .

[11]  Ralph R. Martin,et al.  Creating solid models from single 2D sketches , 1995, Symposium on Solid Modeling and Applications.

[12]  Michael T. Heath,et al.  Scientific Computing: An Introductory Survey , 1996 .

[13]  Hod Lipson,et al.  Identification of Faces in a 2D Line Drawing Projection of a Wireframe Object , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jonathan Richard Shewchuk,et al.  Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator , 1996, WACG.

[15]  Dinesh Manocha,et al.  Applied Computational Geometry Towards Geometric Engineering , 1996, Lecture Notes in Computer Science.

[16]  Michael T. Heath,et al.  Scientific Computing , 2018 .

[17]  Thomas F. Stahovich,et al.  Generating Multiple New Designs from a Sketch , 1996, Artif. Intell..

[18]  Hod Lipson,et al.  Classification of Sketch Strokes and Corner Detection Using Conic Sections and Adaptive Clustering , 1997 .

[19]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[20]  Hod Lipson,et al.  Conceptual design and analysis by sketching , 2000, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[21]  W. Godwin.  Article in Press , 2000 .

[22]  Randall Davis.  Position Statement and Overview: Sketch Recognition at MIT , 2002 .

[23]  David H. Eberly,et al.  Geometric Tools for Computer Graphics , 2002 .

[24]  W. Press,et al.  Numerical Recipes in C++: The Art of Scientific Computing (2nd edn)1 Numerical Recipes Example Book (C++) (2nd edn)2 Numerical Recipes Multi-Language Code CD ROM with LINUX or UNIX Single-Screen License Revised Version3 , 2003 .

[25]  Satoshi Matsuoka,et al.  Teddy: a sketching interface for 3D freeform design , 2006, SIGGRAPH Courses.

[26]  Hod Lipson,et al.  Correlation-based reconstruction of a 3D object from a single freehand sketch , 2007, SIGGRAPH Courses.

[27]  John F. Hughes,et al.  SKETCH: An Interface for Sketching 3D Scenes , 1996, SIGGRAPH.

[28]  Hod Lipson,et al.  Optimization-based reconstruction of a 3D object from a single freehand line drawing , 1996, Comput. Aided Des..