Single viewpoint model completion of symmetric objects for digital inspection

The ability to create complete 3D models of real-world objects is an important task for various applications. In digital inspection, complete models allow users to analyze the entirety of an object. However, various difficulties arise for image-based acquisition techniques. First, the viewpoint planning problem must be solved. Second, each of the resulting view point captures must be combined with either zippering or 3D triangulation, both difficult problems. We observe that if an object is symmetric, then the object's symmetry can be exploited so that a single viewpoint capture is sufficient to generate a complete, 3D triangulated model. In our work, three problems of previous approaches to generating complete models are avoided or minimized: (1) we avoid 3D triangulation, (2) we avoid searches for geometry to extend our models, and (3) we minimize viewpoint planning to the selection of a single viewpoint. Our approach also includes algorithms to mitigate global deformations due to capture error. We demonstrate our approach by capturing, reconstructing, and completing several scenes of one or more objects and illustrating several digital inspection methods with these scenes.

[1]  Daniel G. Aliaga Digital inspection: an interactive stage for viewing surface details , 2008, I3D '08.

[2]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[3]  Daniel G. Aliaga,et al.  A Self-Calibrating Method for Photogeometric Acquisition of 3D Objects , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Daphna Weinshall,et al.  Using Bilateral Symmetry to Improve 3D Reconstruction from Image Sequences , 1997, Comput. Vis. Image Underst..

[5]  Tamal K. Dey,et al.  Tight cocone: a water-tight surface reconstructor , 2003, SM '03.

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Helmut Pottmann,et al.  Rotational and helical surface approximation for reverse engineering , 1998, Computing.

[8]  Marc Alexa,et al.  Context-based surface completion , 2004, ACM Trans. Graph..

[9]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, ACM Trans. Graph..

[10]  Leonidas J. Guibas,et al.  Example-Based 3D Scan Completion , 2005 .

[11]  Suya You,et al.  Rapid part-based 3D modeling , 2005, VRST '05.

[12]  Szymon Rusinkiewicz,et al.  Modeling by example , 2004, SIGGRAPH 2004.

[13]  Evangelos Kalogerakis,et al.  Folding meshes: hierarchical mesh segmentation based on planar symmetry , 2006, SGP '06.

[14]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[15]  Daniel Cohen-Or,et al.  4-points congruent sets for robust pairwise surface registration , 2008, ACM Trans. Graph..

[16]  Szymon Rusinkiewicz,et al.  Exaggerated shading for depicting shape and detail , 2006, ACM Trans. Graph..

[17]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[18]  Daniel Cohen-Or,et al.  Curve skeleton extraction from incomplete point cloud , 2009, ACM Trans. Graph..

[19]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[20]  G. Roth,et al.  View planning for automated three-dimensional object reconstruction and inspection , 2003, CSUR.

[21]  In-Kwon Lee,et al.  Curve reconstruction from unorganized points , 2000, Comput. Aided Geom. Des..

[22]  Marc Levoy,et al.  A hierarchical method for aligning warped meshes , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[23]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, ACM Trans. Graph..

[24]  Leonidas J. Guibas,et al.  Dynamic geometry registration , 2007, Symposium on Geometry Processing.

[25]  N. Mitra,et al.  4-points congruent sets for robust pairwise surface registration , 2008, SIGGRAPH 2008.

[26]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[27]  Sebastian Thrun,et al.  Shape from symmetry , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[28]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[29]  Szymon Rusinkiewicz,et al.  Global non-rigid alignment of 3-D scans , 2007, ACM Trans. Graph..