Interactive Image‐Guided Modeling of Extruded Shapes

A recent trend in interactive modeling of 3D shapes from a single image is designing minimal interfaces, and accompanying algorithms, for modeling a specific class of objects. Expanding upon the range of shapes that existing minimal interfaces can model, we present an interactive image‐guided tool for modeling shapes made up of extruded parts. An extruded part is represented by extruding a closed planar curve, called base, in the direction orthogonal to the base. To model each extruded part, the user only needs to sketch the projected base shape in the image. The main technical contribution is a novel optimization‐based approach for recovering the 3D normal of the base of an extruded object by exploring both geometric regularity of the sketched curve and image contents. We developed a convenient interface for modeling multi‐part shapes and a method for optimizing the relative placement of the parts. Our tool is validated using synthetic data and tested on real‐world images.

[1]  Harry Shum,et al.  Sketching reality: Realistic interpretation of architectural designs , 2008, TOGS.

[2]  Shi-Min Hu,et al.  Sketch2Scene: sketch-based co-retrieval and co-placement of 3D models , 2013, ACM Trans. Graph..

[3]  Ralph R. Martin,et al.  A system for constructing boundary representation solid models from a two-dimensional sketch , 2000, Proceedings Geometric Modeling and Processing 2000. Theory and Applications.

[4]  Markus H. Gross,et al.  3D modeling with a symmetric sketch , 2011, SBIM '11.

[5]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Daniel Cohen-Or,et al.  3-Sweep , 2013, ACM Trans. Graph..

[7]  Alec R. Rivers,et al.  3D modeling with silhouettes , 2010, ACM Trans. Graph..

[8]  K. Sugihara.  Machine interpretation of line drawings , 1986, MIT Press series in artificial intelligence.

[9]  Zhenguo Li,et al.  A Closed-form Solution to 3D Reconstruction of Piecewise Planar Objects from Single Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Ralph R. Martin,et al.  Estimating depth from line drawing , 2002, SMA '02.

[11]  Takeo Igarashi,et al.  Modeling-in-Context: User Design of Complementary Objects with a Single Photo , 2010, SBIM.

[12]  Xiaoou Tang,et al.  3-D Modeling From a Single View of a Symmetric Object , 2012, IEEE Transactions on Image Processing.

[13]  Loong Fah Cheong,et al.  Symmetric architecture modeling with a single image , 2009, ACM Trans. Graph..

[14]  Adrien Bousseau,et al.  True2Form: 3D curve networks from 2D sketches via selective regularization , 2014, ACM Trans. Graph..

[15]  Yu Chen,et al.  3D reconstruction of curved objects from single 2D line drawings , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[17]  Ming-Ming Cheng.  Curve Structure Extraction for Cartoon Images , 1996 .

[18]  Marc Alexa,et al.  Sketch-based shape retrieval , 2012, ACM Trans. Graph..

[19]  Jianbo Liu,et al.  Precise 3D Reconstruction from a Single Image , 2012, ACCV.

[20]  Hod Lipson,et al.  Optimization-based reconstruction of a 3D object from a single freehand line drawing , 1996, Comput. Aided Des..

[21]  Kun Zhou,et al.  Interactive images , 2012, ACM Trans. Graph..

[22]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[23]  Hao Zhang,et al.  Photo-inspired model-driven 3D object modeling , 2011, SIGGRAPH 2011.

[24]  Abhishek Ranjan,et al.  A suggestive interface for image guided 3D sketching , 2004, CHI.

[25]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[26]  Peter F. Sturm,et al.  Using geometric constraints through parallelepipeds for calibration and 3D modeling , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Long Quan,et al.  Image-Based Modeling of Unwrappable Façades , 2013, IEEE Transactions on Visualization and Computer Graphics.

[28]  Jorge Nocedal,et al.  Knitro: An Integrated Package for Nonlinear Optimization , 2006 .

[29]  Peter Wonka,et al.  Interactive architectural modeling with procedural extrusions , 2011, TOGS.

[30]  Yu Guo,et al.  Deformable model for estimating clothed and naked human shapes from a single image , 2013, The Visual Computer.