Improving the digitization of shape and color of 3D artworks in a cluttered environment

We propose an approach for improving the digitization of shape and color of 3D artworks in a cluttered environment using 3D laser scanning and flash photography. In order to separate clutter from acquired material, semi-automated methods are employed to generate masks for segment the 2D range maps and the color photographs, removing unwanted 3D and color data prior to 3D integration. Sharp shadows generated by flash acquisition are trivially handled by this masking process, and color deviations introduced by the flash light are corrected at color blending time by taking into account the object geometry. The approach has been applied to, and evaluated on, a large scale acquisition campaign of the Mont'e Prama complex, an extraordinary collection of stone fragments from the Nuragic era, depicting larger-than-life archers, warriors, boxers, as well as small models of prehistoric nuraghe (cone-shaped stone towers). The acquisition campaign has covered 36 statues mounted on metallic supports, acquired at 0.25mm resolution, resulting in over 6200 range scans (over 1.3G valid samples) and 3426 10Mpixel photographs.

[1]  Michael Wimmer,et al.  Out-of-core selection and editing of huge point clouds , 2011, Comput. Graph..

[2]  Paolo Cignoni,et al.  Stereo Light Probe , 2008, Comput. Graph. Forum.

[3]  Paolo Cignoni,et al.  Masked photo blending: Mapping dense photographic data set on high-resolution sampled 3D models , 2008, Comput. Graph..

[4]  Ruggero Pintus,et al.  Fast and Robust Semi-Automatic Registration of Photographs to 3D Geometry , 2011, VAST.

[5]  Renato Pajarola,et al.  Fast low-memory streaming MLS reconstruction of point-sampled surfaces , 2009, Graphics Interface.

[6]  Roberto Scopigno,et al.  Fully Automatic Registration of Image Sets on Approximate Geometry , 2012, International Journal of Computer Vision.

[7]  William A. Barrett,et al.  Toboggan-based intelligent scissors with a four-parameter edge model , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[8]  Ruggero Pintus,et al.  Fast low-memory seamless photo blending on massive point clouds using a streaming framework , 2011, JOCCH.

[9]  Michael Wand,et al.  Interactive Editing of Large Point Clouds , 2007, PBG@Eurographics.

[10]  Noel E. O'Connor,et al.  A comparative evaluation of interactive segmentation algorithms , 2010, Pattern Recognit..

[11]  Stephen Lin,et al.  A New In-Camera Imaging Model for Color Computer Vision and Its Application , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Lawrence Cayton,et al.  Accelerating Nearest Neighbor Search on Manycore Systems , 2011, 2012 IEEE 26th International Parallel and Distributed Processing Symposium.

[13]  F. Stanco,et al.  Digital Imaging for Cultural Heritage Preservation: Analysis, Restoration, and Reconstruction of Ancient Artworks , 2011 .

[14]  Gabriel Taubin,et al.  SSD: Smooth Signed Distance Surface Reconstruction , 2011, Comput. Graph. Forum.

[15]  Paolo Cignoni,et al.  Exploiting the scanning sequence for automatic registration of large sets of range maps , 2005, Comput. Graph. Forum.

[16]  Ning Xu,et al.  Object segmentation using graph cuts based active contours , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[17]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[18]  Michael Wimmer,et al.  Eurographics Symposium on Point-based Graphics (2006) Instant Points: Fast Rendering of Unprocessed Point Clouds , 2022 .

[19]  Josiah Manson,et al.  Streaming Surface Reconstruction Using Wavelets , 2008, Comput. Graph. Forum.

[20]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[21]  Carlo Tomasi,et al.  Alpha estimation in natural images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[22]  Florent Lafarge,et al.  Creating Large-Scale City Models from 3D-Point Clouds: A Robust Approach with Hybrid Representation , 2012, International Journal of Computer Vision.

[23]  Antonio Adán,et al.  3D Reconstruction of Interior Wall Surfaces under Occlusion and Clutter , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[24]  R. Pintus,et al.  A Streaming Framework for Seamless Detailed Photo Blending on Massive Point Clouds , 2011, Eurographics.

[25]  Paolo Cignoni,et al.  Flash Lighting Space Sampling , 2009, MIRAGE.

[26]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[27]  Paolo Cignoni,et al.  Improved color acquisition and mapping on 3D models via flash-based photography , 2010, JOCCH.

[28]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[29]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[30]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[31]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[32]  Dimitris Samaras,et al.  Topology cuts: A novel min-cut/max-flow algorithm for topology preserving segmentation in N-D images , 2008, Comput. Vis. Image Underst..

[33]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[34]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[35]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[36]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.