Illumination invariant mesh coloring

Many approaches have been proposed for reconstructing photorealistic texture mapping of 3D models with multi-view images. These models can properly represent the objects in fixed light conditions. However, they are unable to react to light changes. In light-changeable application scenarios, such as visual reality, relighting and 3D printing, models without diffuse reflection are highly demanded. In this paper, we present a non-photorealistic per-vertex illumination invariant mesh coloring method to couple intrinsic color information into mesh, which can reflect material properties more accurately. The proposed method consists of two steps: global optimal coloring and label-based intrinsic decomposition. Illumination effect is eliminated in decomposition procedure and color consistency is also implicitly considered. Experiments on 3D printing and model relighting demonstrated that our approach is versatile and practical.

[1]  Seungyong Lee,et al.  Intrinsic Image Decomposition Using Structure-Texture Separation and Surface Normals , 2014, ECCV.

[2]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Michael Goesele,et al.  Let There Be Color! Large-Scale Texturing of 3D Reconstructions , 2014, ECCV.

[4]  Steven M. Seitz,et al.  The Visual Turing Test for Scene Reconstruction , 2013, 2013 International Conference on 3D Vision.

[5]  Stephen Lin,et al.  Estimation of Intrinsic Image Sequences from Image+Depth Video , 2012, ECCV.

[6]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[7]  Mark S. Drew,et al.  Recovering Shading from Color Images , 1992, ECCV.

[8]  Stephen Lin,et al.  Intrinsic image decomposition with non-local texture cues , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Jitendra Malik,et al.  Intrinsic Scene Properties from a Single RGB-D Image , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Hans-Peter Seidel,et al.  Relighting objects from image collections , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Jan-Michael Frahm,et al.  Building Rome on a Cloudless Day , 2010, ECCV.

[12]  Vladlen Koltun,et al.  A Simple Model for Intrinsic Image Decomposition with Depth Cues , 2013, 2013 IEEE International Conference on Computer Vision.

[13]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[14]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[15]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  VekslerOlga,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001 .

[17]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[18]  Sylvain Paris,et al.  User-assisted intrinsic images , 2009, ACM Trans. Graph..

[19]  Daniel Cohen-Or,et al.  Seamless Montage for Texturing Models , 2010, Comput. Graph. Forum.

[20]  Victor S. Lempitsky,et al.  Seamless Mosaicing of Image-Based Texture Maps , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Luiz Velho,et al.  Projective texture atlas construction for 3D photography , 2007, The Visual Computer.

[22]  Paul A. Viola,et al.  Roxels: responsibility weighted 3D volume reconstruction , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[23]  Jan-Michael Frahm,et al.  3D Reconstruction of Dynamic Textures in Crowd Sourced Data , 2014, ECCV.

[24]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[25]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[26]  Adrien Bousseau,et al.  Coherent intrinsic images from photo collections , 2012, ACM Trans. Graph..

[27]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[28]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.