Reconstruction of Relatively Straight Medium to Long Hair Models using Kinect Sensors

Most existing hair capturing methods reconstruct 3D hair models from multi-view stereo based on complex capturing systems composed of many digital cameras and light sources. In this paper, we introduce a novel hair capturing system using consumer RGB-D (Kinect sensors). Our capture system, consisting of three Kinect v2 sensors, is much simpler than previous hair capturing systems. We directly use the 3D point clouds captured by Kinect v2 sensors as the hair volume. Then we adopt a fast and robust image enhancement algorithm to adaptively improve the clarity of the hair strands geometry based on the estimated local strands orientation and frequency from the hair images captured by the Kinect colour sensors. In addition, we introduced a hair strand grow-and-connect algorithm to generate relatively complete hair strands. Furthermore, by projecting the 2D hair strands onto the 3D point clouds, we can obtain the corresponding 3D hair strands. The experimental results indicate that our method can generate plausible 3D models for long, relatively straight hair.

[1]  Steve Marschner,et al.  Capturing hair assemblies fiber by fiber , 2009, SIGGRAPH 2009.

[2]  Ligang Liu,et al.  Scanning 3D Full Human Bodies Using Kinects , 2012, IEEE Transactions on Visualization and Computer Graphics.

[3]  Chongyang Ma,et al.  Robust hair capture using simulated examples , 2014, ACM Trans. Graph..

[4]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[5]  Szymon Rusinkiewicz,et al.  Wide-Baseline Hair Capture Using Strand-Based Refinement , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Paul A. Beardsley,et al.  Coupled 3D reconstruction of sparse facial hair and skin , 2012, ACM Trans. Graph..

[7]  Long Quan,et al.  Modeling hair from multiple views , 2005, SIGGRAPH 2005.

[8]  Frédo Durand,et al.  Hair photobooth , 2008, SIGGRAPH 2008.

[9]  P. Payeur,et al.  Calibration of a network of Kinect sensors for robotic inspection over a large workspace , 2013, 2013 IEEE Workshop on Robot Vision (WORV).

[10]  Szymon Rusinkiewicz,et al.  Structure-aware hair capture , 2013, ACM Trans. Graph..

[11]  Steve Marschner,et al.  A Survey on Hair Modeling: Styling, Simulation, and Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[12]  Szymon Rusinkiewicz,et al.  Multi-view hair capture using orientation fields , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Gérard G. Medioni,et al.  Rapid avatar capture and simulation using commodity depth sensors , 2014, Comput. Animat. Virtual Worlds.

[14]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Anil K. Jain,et al.  Fingerprint Image Enhancement: Algorithm and Performance Evaluation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Jonathan T. Barron,et al.  3D self-portraits , 2013, ACM Trans. Graph..

[17]  Jongmoo Choi,et al.  Accurate Full Body Scanning from a Single Fixed 3D Camera , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[18]  Sylvain Paris,et al.  Capture of hair geometry from multiple images , 2004, ACM Trans. Graph..