3D reconstruction of cultural heritages: Challenges and advances on precise mesh integration

Several methods perform the integration of multiple range scans of an object aiming the generation of a reconstructed triangle mesh; however, achieving high fidelity digital reconstructions is still a challenge. That is mostly due to the existence of outliers in the acquired range data, and their harmful effects on the integration algorithms. In this work, we first discuss artifacts usually found on real range data captured with 3D scanners based on laser triangulation. Following that there is the assessment of two widely used volumetric integration techniques (VRIP and Consensus Surface) and our suggested improvements. We also present a novel, hybrid approach that combines strengths from both VRIP and Consensus Surface, named IMAGO Volumetric Integration Algorithm (IVIA). Our novel algorithm adds new ideas while improving the detection and elimination of artifacts. Further, IVIA works in close cooperation with the subsequent hole filling process, which greatly improves the overall quality of the generated 3D models. Our technique leads to better results when assessed in different situations, when compared to VRIP, Consensus Surface, and also to a well known state-of-the-art surface-based method, Poisson Surface Reconstruction.

[1]  Luciano Silva,et al.  A 3D reconstruction pipeline for digital preservation , 2009, CVPR.

[2]  Herbert Edelsbrunner,et al.  Shape Reconstruction with Delaunay Complex , 1998, LATIN.

[3]  Avinash C. Kak,et al.  3D Modeling of Optically Challenging Objects , 2008, IEEE Transactions on Visualization and Computer Graphics.

[4]  Jindong Chen,et al.  Automatic Reconstruction of 3D CAD Models from Digital Scans , 1999, Int. J. Comput. Geom. Appl..

[5]  Paolo Cignoni,et al.  The Marching Intersections algorithm for merging range images , 2003, The Visual Computer.

[6]  Luciano Silva,et al.  Improving 3D Reconstruction for Digital Art Preservation , 2011, ICIAP.

[7]  Katsushi Ikeuchi,et al.  Consensus surfaces for modeling 3D objects from multiple range images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Atsushi Nakazawa,et al.  The Great Buddha Project: Digitally Archiving, Restoring, and Analyzing Cultural Heritage Objects , 2007, International Journal of Computer Vision.

[9]  Gabriel Taubin,et al.  The ball-pivoting algorithm for surface reconstruction , 1999, IEEE Transactions on Visualization and Computer Graphics.

[10]  George Pavlidis,et al.  Methods for 3D digitization of Cultural Heritage , 2007 .

[11]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[12]  Steve Marschner,et al.  Filling holes in complex surfaces using volumetric diffusion , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[13]  D. Cohen-Or,et al.  Robust moving least-squares fitting with sharp features , 2005, ACM Trans. Graph..

[14]  Randal C. Burns,et al.  Multilevel streaming for out-of-core surface reconstruction , 2007, Symposium on Geometry Processing.

[15]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[16]  Sunghee Choi,et al.  The power crust, unions of balls, and the medial axis transform , 2001, Comput. Geom..

[17]  Luciano Silva,et al.  3D preserving xviii century barroque masterpiece: Challenges and results on the digital preservation of Aleijadinho’s sculpture of the Prophet Joel , 2012 .

[18]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[19]  Meenakshisundaram Gopi,et al.  Surface Reconstruction based on Lower Dimensional Localized Delaunay Triangulation , 2000, Comput. Graph. Forum.

[20]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[21]  Katsushi Ikeuchi,et al.  Robust and adaptive integration of multiple range images with photometric attributes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  James F. O'Brien,et al.  Spectral surface reconstruction from noisy point clouds , 2004, SGP '04.

[23]  Leif Kobbelt,et al.  Robust reconstruction of watertight 3D models from non-uniformly sampled point clouds without normal information , 2006, SGP '06.

[24]  Denis Laurendeau,et al.  A General Surface Approach to the Integration of a Set of Range Views , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Randal C. Burns,et al.  Parallel Poisson Surface Reconstruction , 2009, ISVC.

[26]  E Chernyaev,et al.  Marching cubes 33 : construction of topologically correct isosurfaces , 1995 .

[27]  Tamal K. Dey,et al.  Tight cocone: a water-tight surface reconstructor , 2003, SM '03.

[28]  Daniel Cohen-Or,et al.  Competing Fronts for Coarse–to–Fine Surface Reconstruction , 2006, Comput. Graph. Forum.

[29]  Hans-Peter Seidel,et al.  Multi-level partition of unity implicits , 2005, SIGGRAPH Courses.

[30]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[31]  Katsushi Ikeuchi,et al.  Hole Filling of a 3D Model by Flipping Signs of a Signed Distance Field in Adaptive Resolution , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[33]  Alex Pentland,et al.  Closed-form solutions for physically-based shape modeling and recognition , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Takeshi Masuda,et al.  Object shape modelling from multiple range images by matching signed distance fields , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[35]  Sunghee Choi,et al.  The power crust , 2001, SMA '01.

[36]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[37]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[38]  Katsushi Ikeuchi,et al.  Adaptively merging large-scale range data with reflectance properties , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Katsushi Ikeuchi,et al.  Taking consensus of signed distance field for complementing unobservable surface , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[40]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[41]  Hong Zhou,et al.  Accurate integration of multi-view range images using k-means clustering , 2008, Pattern Recognit..

[42]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[43]  Luciano Silva,et al.  Digital preservation of Brazilian indigenous artworks: Generating high quality textures for 3D models , 2012 .

[44]  Yücel Yemez,et al.  A volumetric fusion technique for surface reconstruction from silhouettes and range data , 2007, Comput. Vis. Image Underst..

[45]  Yutaka Takase,et al.  The Great Buddha Project: Modelling Cultural Heritage through Observation , 2001 .

[46]  Gabriel Taubin,et al.  Building a Digital Model of Michelangelo's Florentine Pietà , 2002, IEEE Computer Graphics and Applications.

[47]  S. Osher,et al.  Fast surface reconstruction using the level set method , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[48]  Adrian Hilton,et al.  Reliable Surface Reconstructiuon from Multiple Range Images , 1996, ECCV.

[49]  Diego F. Nehab,et al.  Efficiently combining positions and normals for precise 3D geometry , 2005, SIGGRAPH 2005.

[50]  Luciano Silva,et al.  Planar background elimination in range images: A practical approach , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).