Fast color correction for rapid scanning in uncontrolled environment

This work addresses the problem of colorizing correctly time-of-flight 3D scans performed during rapid scanning of a site in natural and uncontrolled lighting conditions. Contrarily to the usual approach correcting high resolution pictures, the proposed method combines all available radiometric information to colorize per vertex the medium resolution depth map. The obtained rendering exhibits no visible artifacts, for models composed of a series of scans. Our solution allows to quickly obtain good visual results within a reasonable time, while allowing to consider various other methods to improve colors and rendering.

[1]  Peter K. Allen,et al.  Building Illumination Coherent 3D Models of Large-Scale Outdoor Scenes , 2008, International Journal of Computer Vision.

[2]  Jan Kautz,et al.  Exposure Fusion , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[3]  Hiroshi Nagahashi,et al.  Cross-Parameterization for Triangular Meshes with Semantic Features , 2007 .

[4]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[5]  Robert B. Fisher,et al.  Colour texture fusion of multiple range images , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[6]  Holly E. Rushmeier,et al.  High-Quality Texture Reconstruction from Multiple Scans , 2001, IEEE Trans. Vis. Comput. Graph..

[7]  R. Love.  Surface reflection model estimation from naturally illuminated image sequences , 1997 .

[8]  Marc Alexa,et al.  Exposure Fusion for Time‐Of‐Flight Imaging , 2011, Comput. Graph. Forum.

[9]  Wei Xu,et al.  Performance evaluation of color correction approaches for automatic multi-view image and video stitching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Hans-Peter Seidel,et al.  Automated texture registration and stitching for real world models , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[11]  Robert B. Fisher,et al.  Fusing multiple color images for texturing models , 2004 .

[12]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Sébastien Roy,et al.  Automatic relighting of overlapping textures of a 3D model , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[14]  Paul E. Debevec,et al.  Digitizing the Parthenon: Estimating Surface Reflectance Properties of a Complex Scene under Captured Natural Illumination , 2004, VMV.

[15]  Steve Marschner,et al.  Inverse Lighting for Photography , 1997, CIC.

[16]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[17]  Paolo Cignoni,et al.  Reconstructing Textured Meshes from Multiple Range RGB Maps , 2002, VMV.

[18]  Jitendra Malik,et al.  Recovering photometric properties of architectural scenes from photographs , 1998, SIGGRAPH.

[19]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[20]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[21]  Paolo Cignoni,et al.  Masked photo blending: Mapping dense photographic data set on high-resolution sampled 3D models , 2008, Comput. Graph..

[22]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[23]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[24]  Adam Baumberg,et al.  Blending Images for Texturing 3D Models , 2002, BMVC.