Photorealistic Texturing of Human Busts Reconstructions

Recent developments in the RGBD sensors systems, lead to a new generation of sensors providing high quality color images along with moderate depth resolution images. Most state-of-the-art real-time reconstruction algorithms support colorized reconstruction by methods that rely on vertex colorization. However, the resolution of vertex colorization is directly linked to mesh resolution. High quality color images therefore require an enormous amount of vertices in order to capture image details. This leads to unattractive large model files, large memory consumption and long processing times. In this work we propose an automated pipeline that is able to texture low-resolution geometric meshes with high quality color images. Experiments evaluate the proposed method in challenging environments such as varying illumination and non-rigid reconstructions.

[1]  Daniel Cohen-Or,et al.  Seamless Montage for Texturing Models , 2010, Comput. Graph. Forum.

[2]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[3]  Luiz Velho,et al.  Kinect and RGBD Images: Challenges and Applications , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images Tutorials.

[4]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[5]  Bruno Lévy,et al.  Least squares conformal maps for automatic texture atlas generation , 2002, ACM Trans. Graph..

[6]  Victor S. Lempitsky,et al.  Seamless Mosaicing of Image-Based Texture Maps , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Christoph Heindl,et al.  Capturing Photorealistic and Printable 3D Models Using Low-Cost Hardware , 2016, ISVC.

[8]  Marc Rioux,et al.  A texture-mapping approach for the compression of colored 3D triangulations , 1996, The Visual Computer.

[9]  A. Requicha.  CONSTRUCTIVE SOLID GEOMETRY , 1977 .

[10]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[12]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[13]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[14]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[15]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[16]  Jonathan T. Barron,et al.  3D self-portraits , 2013, ACM Trans. Graph..

[17]  Paolo Cignoni,et al.  Multiple Texture Stitching and Blending on 3D Objects , 1999, Rendering Techniques.

[18]  Andreas Pichler,et al.  ReconstructMe SDK: a C API for Real-time 3D Scanning , 2015 .

[19]  Sayali Baheti,et al.  Region Filling and Object Removal by Exemplar based Image Inpainting , 2015 .

[20]  Edward G. Coffman,et al.  Approximation algorithms for bin packing: a survey , 1996 .