3D modeling with a symmetric sketch

We propose a method that allows geometric operations such as view change, deformation, simulation, or symmetrization on a single off-line sketch via a proxy geometry reconstructed directly from the sketch. The reconstruction captures the overall shape of the object depicted by making use of the global relationships of the curves and the assumption that the sketched object is bilaterally symmetric. After cleaning the sketch and extracting the curves, topological and geometric properties of a set of identified points are used to derive robust correspondence and pairwise constraints. These constraints are considered all at once in a spectral algorithm to get the optimum matching of the curves. Depths of points on the matched curves are extracted by utilizing the symmetry assumption. They are then used to reconstruct a smooth geometry. The whole process is automatic except for a few seconds of user interaction.

[1]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[2]  George Celniker,et al.  Deformable curve and surface finite-elements for free-form shape design , 1991, SIGGRAPH.

[3]  Marc Alexa,et al.  A descriptor for large scale image retrieval based on sketched feature lines , 2009, SBIM '09.

[4]  Faramarz F. Samavati,et al.  Stroke Extraction and Classification for Mesh Inflation , 2010, SBIM.

[5]  Frédo Durand,et al.  2.5D cartoon models , 2010, ACM Trans. Graph..

[6]  Gérard G. Medioni,et al.  Reconstructing mirror symmetric scenes from a single view using 2-view stereo geometry , 2002, Object recognition supported by user interaction for service robots.

[7]  Donald D. Hoffman Visual Intelligence: How We Create What We See , 1998 .

[8]  Allen Y. Yang,et al.  On Symmetry and Multiple-View Geometry: Structure, Pose, and Calibration from a Single Image , 2004, International Journal of Computer Vision.

[9]  Kun Huang,et al.  Symmetry-based photo editing , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[10]  Donald D. Hoffman,et al.  Visual Intelligence: How We Create What We See , 1998 .

[11]  John Dingliana,et al.  Adding Depth to Cartoons Using Sparse Depth (In)equalities , 2010, Comput. Graph. Forum.

[12]  Allen Y. Yang,et al.  Symmetry-based 3-D reconstruction from perspective images , 2005, Comput. Vis. Image Underst..

[13]  Allen R. Hanson,et al.  Perceptual Completion of Occluded Surfaces , 1996, Comput. Vis. Image Underst..

[14]  P. A. C. Varley,et al.  Sketch input of 3D models - current directions , 2007, VISAPP.

[15]  Zygmunt Pizlo,et al.  Binocular shape constancy from novel views: The role of a priori constraints , 2006, Perception & psychophysics.

[16]  Faramarz F. Samavati,et al.  Image-assisted modeling from sketches , 2010, Graphics Interface.

[17]  Harry Shum,et al.  Sketching reality: Realistic interpretation of architectural designs , 2008, TOGS.

[18]  Jitendra Malik,et al.  Interpreting line drawings of curved objects , 1986, International Journal of Computer Vision.

[19]  Soonhung Han,et al.  A template-based reconstruction of plane-symmetric 3D models from freehand sketches , 2008, Comput. Aided Des..

[20]  C. Tyler Human Symmetry Perception and Its Computational Analysis , 2002 .

[21]  J. Hughes,et al.  SmoothSketch: 3D free-form shapes from complex sketches , 2006, ACM Trans. Graph..

[22]  Loong Fah Cheong,et al.  Symmetric architecture modeling with a single image , 2009, ACM Trans. Graph..

[23]  Elaine Cohen,et al.  Eurographics Workshop on Sketch-based Interfaces and Modeling (2006) Producing Models from Drawings of Curved Surfaces , 2022 .

[24]  Adam Finkelstein,et al.  How well do line drawings depict shape , 2009, SIGGRAPH 2009.

[25]  Tai-Pang Wu,et al.  Surface-from-Gradients without Discrete Integrability Enforcement: A Gaussian Kernel Approach , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[27]  Theo Pavlidis,et al.  Algorithms for Graphics and Imag , 1983 .

[28]  Allen R. Hanson,et al.  Perceptual completion of occluded surfaces , 1996, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[29]  R.M. McElhaney,et al.  Algorithms for graphics and image processing , 1983, Proceedings of the IEEE.

[30]  T. Poggio,et al.  Symmetric 3D objects are an easy case for 2D object recognition. , 1994, Spatial vision.

[31]  Alec R. Rivers,et al.  3D modeling with silhouettes , 2010, ACM Trans. Graph..

[32]  Li Zhang,et al.  Single view modeling of free-form scenes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[33]  Ravin Balakrishnan,et al.  ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models , 2008, UIST '08.

[34]  T. Pavlidis Algorithms for Graphics and Image Processing , 1981, Springer Berlin Heidelberg.

[35]  Takeo Igarashi,et al.  Structured annotations for 2D-to-3D modeling , 2009, ACM Trans. Graph..

[36]  Linda G. Shapiro,et al.  Computer Vision , 2001 .

[37]  John F. Hughes,et al.  SmoothSketch: 3D free-form shapes from complex sketches , 2006, SIGGRAPH '06.

[38]  Adam Finkelstein,et al.  Where do people draw lines? , 2008, ACM Trans. Graph..

[39]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[40]  Nikolaus F. Troje,et al.  How is bilateral symmetry of human faces used for recognition of novel views? , 1998, Vision Research.

[41]  Yizhou Yu,et al.  Reconstruction of 3-D Symmetric Curves from Perspective Images without Discrete Features , 2004, ECCV.

[42]  Mario Costa Sousa,et al.  A Taxonomy of Modeling Techniques using Sketch-Based Interfaces , 2008, Eurographics.

[43]  George Drettakis,et al.  Drawing for Illustration and Annotation in 3D , 2001, Comput. Graph. Forum.

[44]  Jun-yong Noh,et al.  Sketching of Mirror-Symmetric Shapes , 2011, IEEE Transactions on Visualization and Computer Graphics.

[45]  Adam Finkelstein,et al.  How well do line drawings depict shape? , 2009, SIGGRAPH '09.