Interactive modeling of lofted shapes from a single image

Modeling the complete geometry of general shapes from a single image is an ill-posed problem. User hints are often incorporated to resolve ambiguities and provide guidance during the modeling process. In this work, we present a novel interactive approach for extracting high-quality freeform shapes from a single image. This is inspired by the popular lofting technique in many CAD systems, and only requires minimal user input. Given an input image, the user only needs to sketch several projected cross sections, provide a “main axis”, and specify some geometric relations. Our algorithm then automatically optimizes the common normal to the sections with respect to these constraints, and interpolates between the sections, resulting in a high-quality 3D model that conforms to both the original image and the user input. The entire modeling session is efficient and intuitive. We demonstrate the effectiveness of our approach based on qualitative tests on a variety of images, and quantitative comparisons with the ground truth using synthetic images.

[1]  Ligang Liu,et al.  Photo-inspired model-driven 3D object modeling , 2011, ACM Trans. Graph..

[2]  Vladlen Koltun,et al.  Single-view reconstruction via joint analysis of image and shape collections , 2015, ACM Trans. Graph..

[3]  Ping Tan,et al.  Symmetric architecture modeling with a single image , 2009, SIGGRAPH 2009.

[4]  Peisheng Gao,et al.  2-D shape blending: an intrinsic solution to the vertex path problem , 1993, SIGGRAPH.

[5]  Thomas Hermann,et al.  G2 interpolation of free form curve networks by biquintic Gregory patches , 1996, Comput. Aided Geom. Des..

[6]  Adrien Bousseau,et al.  True2Form: 3D curve networks from 2D sketches via selective regularization , 2014, ACM Trans. Graph..

[7]  Ryan Schmidt,et al.  Analytic drawing of 3D scaffolds , 2009, SIGGRAPH 2009.

[8]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[9]  Kun Zhou,et al.  Interactive images , 2012, ACM Trans. Graph..

[10]  Daniel G. Aliaga,et al.  Procedural Modeling of a Building from a Single Image , 2018, Comput. Graph. Forum.

[11]  Pengfei Xu,et al.  SweepCanvas: Sketch-based 3D Prototyping on an RGB-D Image , 2017, UIST.

[12]  Brian Wyvill,et al.  ShapeShop: sketch-based solid modeling with BlobTrees , 2006, SIGGRAPH Courses.

[13]  E. Catmull,et al.  Recursively generated B-spline surfaces on arbitrary topological meshes , 1978 .

[14]  Yaser Sheikh,et al.  3D object manipulation in a single photograph using stock 3D models , 2014, ACM Trans. Graph..

[15]  Daniel Cohen-Or,et al.  Sketch‐to‐Design: Context‐Based Part Assembly , 2012, Comput. Graph. Forum.

[16]  Hiroaki Chiyokura,et al.  Design of solids with free-form surfaces , 1983, SIGGRAPH.

[17]  Scott Schaefer,et al.  Lofting curve networks using subdivision surfaces , 2004, SGP '04.

[18]  Jianxiong Xiao,et al.  Single image tree modeling , 2008, SIGGRAPH 2008.

[19]  Ligang Liu,et al.  A survey of sketch based modeling systems , 2016, Frontiers of Computer Science.

[20]  Thomas W. Sederberg,et al.  A physically based approach to 2–D shape blending , 1992, SIGGRAPH.

[21]  Suguru Saito,et al.  Single-view sketch based modeling , 2011, SBIM '11.

[22]  Daniel Cohen-Or,et al.  3-Sweep , 2013, ACM Trans. Graph..

[23]  Daniel Cohen-Or,et al.  Geosemantic Snapping for Sketch‐Based Modeling , 2013, Comput. Graph. Forum.

[24]  Bin Zhou,et al.  Garment Modeling from a Single Image , 2013, Comput. Graph. Forum.

[25]  W SederbergThomas,et al.  A physically based approach to 2D shape blending , 1992 .

[26]  Wenping Wang,et al.  BendSketch , 2017, ACM Trans. Graph..

[27]  Hujun Bao,et al.  Symmetry and Orbit Detection via Lie‐Algebra Voting , 2016, Comput. Graph. Forum.

[28]  Shi-Min Hu,et al.  Interactive Image‐Guided Modeling of Extruded Shapes , 2014, Comput. Graph. Forum.

[29]  Shi-Min Hu,et al.  Sketch2Scene: sketch-based co-retrieval and co-placement of 3D models , 2013, ACM Trans. Graph..

[30]  ChiyokuraHiroaki,et al.  Design of solids with free-form surfaces , 1983 .

[31]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[32]  Ahmad H. Nasri,et al.  Curve interpolation in recursively generated B-spline surfaces over arbitrary topology , 1997, Comput. Aided Geom. Des..

[33]  Takeo Igarashi,et al.  Bubble clusters: an interface for manipulating spatial aggregation of graphical objects , 2007, UIST.

[34]  Kun Zhou,et al.  AutoSweep: Recovering 3D Editable Objects from a Single Photograph , 2020, IEEE Transactions on Visualization and Computer Graphics.

[35]  Ahmad H. Nasri,et al.  Interpolating an Unlimited Number of Curves Meeting at Extraordinary Points on Subdivision Surfaces * , 2003, Comput. Graph. Forum.