Image-based approaches to hair modeling

Hair is a relevant characteristic of virtual characters, therefore the modeling of plausible facial hair and hairstyles is an essential step in the generation of computer generated (CG) avatars. However, the inherent geometric complexity of hair together with the huge number of filaments of an average human head make the task of modeling hairstyles a very challenging one. To date this is commonly a manual process which requires artist skills or very specialized and costly acquisition software. In this work we present an image-based approach to model facial hair (beard and eyebrows) and (head) hairstyles. Since facial hair is usually much shorter than the average head hair two different methods are presented, adapted to the characteristics of the hair to be modeled. Facial hair is modeled using data extracted from facial texture images and missing information is inferred by means of a database-driven prior model. Our hairstyle reconstruction technique employs images of the hair to be modeled taken with a thermal camera. The major advantage of our thermal image-based method over conventional image-based techniques lies on the fact that during data capture the hairstyle is “lit from the inside”: the thermal camera captures heat irradiated by the head and actively re-emitted by the hair filaments almost isotropically. Following this approach we can avoid several issues of conventional image-based techniques, like shadowing or anisotropy in reflectance. The presented technique requires minimal user interaction and a simple acquisition setup. Several challenging examples demonstrate the potential of the proposed approach.

[1]  Märtha Sund-Levander,et al.  Normal oral, rectal, tympanic and axillary body temperature in adult men and women: a systematic literature review. , 2002, Scandinavian journal of caring sciences.

[2]  Shaun Bangay,et al.  Modelling and rendering techniques for African hairstyles , 2004, AFRIGRAPH '04.

[3]  Steve Marschner,et al.  Strands and hair: modeling, animation, and rendering , 2007, SIGGRAPH Courses.

[4]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[5]  Guillaume-Alexandre Bilodeau,et al.  Machine Vision and Applications Manuscript No. Body Temperature Estimation of a Moving Subject from Thermographic Images , 2022 .

[6]  Yazhu Chen,et al.  Design of a 3-D Infrared Imaging System Using Structured Light , 2011, IEEE Transactions on Instrumentation and Measurement.

[7]  W. Freeman Steerable filters and local analysis of image structure , 1992 .

[8]  A. Severdia,et al.  Infrared Spectra of a Single Human Hair , 1983 .

[9]  Larry S. Davis,et al.  Detection and analysis of hair , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Markus H. Gross,et al.  Optimized Spatial Hashing for Collision Detection of Deformable Objects , 2003, VMV.

[11]  Steve Marschner,et al.  Image-Based Hair Capture by Inverse Lighting , 2002, Graphics Interface.

[12]  C. Robbins Morphological and Macromolecular Structure , 1994 .

[13]  W. Wolfe,et al.  The Infrared Handbook , 1985 .

[14]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Steve Marschner,et al.  Capturing hair assemblies fiber by fiber , 2009, SIGGRAPH 2009.

[16]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Sami Romdhani,et al.  A 3D Face Model for Pose and Illumination Invariant Face Recognition , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[18]  Long Quan,et al.  Modeling hair from multiple views , 2005, SIGGRAPH 2005.

[19]  Yasuhiko Watanabe,et al.  A trigonal prism-based method for hair image generation , 1992, IEEE Computer Graphics and Applications.

[20]  Andreas Weber,et al.  Hairstyle Construction from Raw Surface Data , 2006, International Conference on Computer Graphics, Imaging and Visualisation (CGIV'06).

[21]  Ming C. Lin,et al.  Modeling hair using level-of-detail representations , 2003, Proceedings 11th IEEE International Workshop on Program Comprehension.

[22]  Marie-Paule Cani,et al.  Predicting Natural Hair Shapes by Solving the Statics of Flexible Rods , 2005, Eurographics.

[23]  Yizhou Yu,et al.  Modeling realistic virtual hairstyles , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[24]  Reinhard Klein,et al.  A practical approach for photometric acquisition of hair color , 2009, SIGGRAPH 2009.

[25]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Ken-ichi Anjyo,et al.  A simple method for extracting the natural beauty of hair , 1992, SIGGRAPH.

[27]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[28]  Arno Zinke,et al.  Light Scattering from Filaments , 2007, IEEE Transactions on Visualization and Computer Graphics.

[29]  Pierre-Yves Coulon,et al.  Frequential and color analysis for hair mask segmentation , 2008, 2008 15th IEEE International Conference on Image Processing.

[30]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[31]  Eero P. Simoncelli,et al.  Steerable wedge filters for local orientation analysis , 1996, IEEE Trans. Image Process..

[32]  Zhan Xu,et al.  V-HairStudio: An Interactive Tool for Hair Design , 2001, IEEE Computer Graphics and Applications.

[33]  Olga Veksler,et al.  Graph Cuts in Vision and Graphics: Theories and Applications , 2006, Handbook of Mathematical Models in Computer Vision.

[34]  P. Milanfar,et al.  Multiscale principal components analysis for image local orientation estimation , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[35]  Peter Eisert,et al.  Adaptive color classification for structured light systems , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[36]  Hung-Ming Sun,et al.  Skin detection for single images using dynamic skin color modeling , 2010, Pattern Recognit..

[37]  Brent A. Nelson,et al.  Radiative Properties of Polar Bear Hair , 2002 .

[38]  Detektoren für optische Strahlung , 2007 .

[39]  James A. Sethian,et al.  A real-time algorithm for medical shape recovery , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[40]  Paul A. Beardsley,et al.  Coupled 3D reconstruction of sparse facial hair and skin , 2012, ACM Trans. Graph..

[41]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[42]  Long Quan,et al.  Sketching hairstyles , 2007, SBIM '07.

[43]  Steve Marschner,et al.  A Survey on Hair Modeling: Styling, Simulation, and Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[44]  Ashok Veeraraghavan,et al.  Structured light 3D scanning in the presence of global illumination , 2011, CVPR 2011.

[45]  Raimondo Schettini,et al.  Skin segmentation using multiple thresholding , 2006, Electronic Imaging.

[46]  Javier Ruiz-del-Solar,et al.  Skin detection using neighborhood information , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[47]  Tomoyuki Nishita,et al.  Animating Hair with Loosely Connected Particles , 2003, Comput. Graph. Forum.

[48]  Roberto Cipolla,et al.  Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[50]  Steve Marschner,et al.  Realistic hair simulation: animation and rendering , 2008, SIGGRAPH '08.

[51]  Wen Tang,et al.  Modelling and animating cartoon hair with NURBS surfaces , 2004, Proceedings Computer Graphics International, 2004..

[52]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[53]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color and edge information , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[54]  Frédo Durand,et al.  Hair photobooth , 2008, SIGGRAPH 2008.

[55]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[56]  Darko Kolaric,et al.  Thermography surveillance after breast conserving surgery — Three cases , 2011, Proceedings ELMAR-2011.

[57]  David J. Fleet,et al.  Optical Flow Estimation , 2006, Handbook of Mathematical Models in Computer Vision.

[58]  Nadia Magnenat-Thalmann,et al.  Interactive Hair Styler based on Fluid Flow , 2000, Computer Animation and Simulation.

[59]  Marie-Paule Cani,et al.  Realistic Hair from a Sketch , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[60]  Steven M. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, International Journal of Computer Vision.

[61]  Kun Zhou,et al.  Example-based hair geometry synthesis , 2009, ACM Trans. Graph..