Capture of hair geometry using white structured light

Abstract Structured lighting (SL) scanning technology has been successfully applied to reconstruct personalized avatars, providing high-quality geometry for the face and body. However, previous white SL methods have typically been unable to capture and reconstruct hair geometry, preventing a complete, realistic avatar surface from being reconstructed. In this paper, we propose a novel hair capture system, producing a full-head manifold with complete hair, based on four white SL scanners made by ourselves. The key technical contribution is a robust strip-edge-based coding algorithm, using a projection pattern of 18 stripes; it allows geometric acquisition to an accuracy of 1 mm. Experiments are given to show that our system produces high-quality hair geometry, comparable to that captured by more expensive state-of-the-art multiview stereo systems. Our system is however easier to configure, and is more suited to real-world setups.

[1]  Yoshiaki Shirai,et al.  Recognition of polyhedrons with a range finder , 1971, IJCAI.

[2]  Szymon Rusinkiewicz,et al.  Estimating the Laplace‐Beltrami Operator by Restricting 3D Functions , 2009, Comput. Graph. Forum.

[3]  Bo Fu,et al.  Robust near-infrared structured light scanning for 3D human model reconstruction , 2014, Photonics West - Micro and Nano Fabricated Electromechanical and Optical Components.

[4]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[5]  Dieter Fox,et al.  DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[9]  Ralph R. Martin,et al.  Fast capture of textured full-body avatar with RGB-D cameras , 2016, The Visual Computer.

[10]  Hao Yang,et al.  A data-driven approach to four-view image-based hair modeling , 2017, ACM Trans. Graph..

[11]  Szymon Rusinkiewicz,et al.  Structure-aware hair capture , 2013, ACM Trans. Graph..

[12]  Jason Geng,et al.  Structured-light 3D surface imaging: a tutorial , 2011 .

[13]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[14]  Steve Marschner,et al.  A Survey on Hair Modeling: Styling, Simulation, and Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[15]  Kun Zhou,et al.  High-quality hair modeling from a single portrait photo , 2015, ACM Trans. Graph..

[16]  Ronald Chung,et al.  An Accurate and Robust Strip-Edge-Based Structured Light Means for Shiny Surface Micromeasurement in 3-D , 2013, IEEE Transactions on Industrial Electronics.

[17]  Frédo Durand,et al.  Hair photobooth , 2008, SIGGRAPH 2008.

[18]  Thabo Beeler,et al.  High-quality single-shot capture of facial geometry , 2010, ACM Trans. Graph..

[19]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[20]  Kun Zhou,et al.  AutoHair: fully automatic hair modeling from a single image , 2016, ACM Trans. Graph..

[21]  Peter M. Will,et al.  Grid Coding: A Preprocessing Technique for Robot and Machine Vision , 1971, IJCAI.

[22]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[23]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[24]  Thabo Beeler,et al.  High-quality single-shot capture of facial geometry , 2010, SIGGRAPH 2010.

[25]  Chongyang Ma,et al.  Single-view hair modeling using a hairstyle database , 2015, ACM Trans. Graph..

[26]  Diego Gutierrez,et al.  Capturing and stylizing hair for 3D fabrication , 2014, ACM Trans. Graph..

[27]  Hao Li,et al.  Global Correspondence Optimization for Non‐Rigid Registration of Depth Scans , 2008, Comput. Graph. Forum.