A Survey of Image-Based Techniques for Hair Modeling

With the tremendous performance increase of today’s graphics technologies, visual details of digital humans in games, online virtual worlds, and virtual reality applications are becoming significantly more demanding. Hair is a vital component of a person’s identity and can provide strong cues about age, background, and even personality. More and more researchers focus on hair modeling in the fields of computer graphics and virtual reality. Traditional methods are physics-based simulation by setting different parameters. The computation is expensive, and the constructing process is non-intuitive, difficult to control. Conversely, image-based methods have the advantages of fast modeling and high fidelity. This paper surveys the state of the art in the major topics of image-based techniques for hair modeling, including single-view hair modeling, static hair modeling from multiple images, video-based dynamic hair modeling, and the editing and reusing of hair modeling results. We first summarize the single-view approaches, which can be divided into the orientation-field and data-driven-based methods. The static methods from multiple images and dynamic methods are then reviewed in Sections III and IV. In Section V, we also review the editing and reusing of hair modeling results. The future development trends and challenges of image-based methods are proposed in the end.

[1]  Yue Qi,et al.  Realistic hair modeling from a hybrid orientation field , 2016, The Visual Computer.

[2]  Eitan Grinspun,et al.  Supplemental : A Multi-Scale Model for Simulating Liquid-Hair Interactions , 2017 .

[3]  Arno Zinke,et al.  Lighting hair from the inside , 2012, ACM Trans. Graph..

[4]  Eyal Ofek,et al.  Video-Based Modeling of Dynamic Hair , 2009, PSIVT.

[5]  Hao Li,et al.  Avatar digitization from a single image for real-time rendering , 2017, ACM Trans. Graph..

[6]  Huamin Wang,et al.  Simulation Guided Hair Dynamics Modeling from Video , 2012, Comput. Graph. Forum.

[7]  Chi-Wing Fu,et al.  2.5D Cartoon Hair Modeling and Manipulation , 2015, IEEE Transactions on Visualization and Computer Graphics.

[8]  Joëlle Thollot,et al.  Inverse dynamic hair modeling with frictional contact , 2013, ACM Trans. Graph..

[9]  Diego Gutierrez,et al.  Capturing and stylizing hair for 3D fabrication , 2014, ACM Trans. Graph..

[10]  Zhan Yu,et al.  A hybrid image-CAD based system for modeling realistic hairstyles , 2014, I3D.

[11]  Shigeo Morishima,et al.  Hair motion reconstruction using motion capture system , 2007, SIGGRAPH '07.

[12]  E. Grinspun,et al.  Discrete elastic rods , 2008, SIGGRAPH 2008.

[13]  Hyeong-Seok Ko,et al.  Simulating complex hair with robust collision handling , 2005, SCA '05.

[14]  Paul A. Beardsley,et al.  Coupled 3D reconstruction of sparse facial hair and skin , 2012, ACM Trans. Graph..

[15]  Ming C. Lin,et al.  A Simulation-based VR System for Interactive Hairstyling , 2006, IEEE Virtual Reality Conference (VR 2006).

[16]  Wayne E. Carlson,et al.  Simulating the structure and dynamics of human hair: Modelling, rendering and animation , 1991, Comput. Animat. Virtual Worlds.

[17]  Zhipeng Ding,et al.  Single-View Hair Modeling Based on Orientation and Helix Fitting , 2016, 2016 International Conference on Virtual Reality and Visualization (ICVRV).

[18]  Long Quan,et al.  Sketching hairstyles , 2007, SBIM '07.

[19]  Derek Bradley,et al.  Simulation‐Ready Hair Capture , 2017, Comput. Graph. Forum.

[20]  Szymon Rusinkiewicz,et al.  Dynamic Hair Capture , 2011 .

[21]  Menglei Chai,et al.  Adaptive Skinning for Interactive Hair-Solid Simulation , 2017, IEEE Transactions on Visualization and Computer Graphics.

[22]  Szymon Rusinkiewicz,et al.  Multi-view hair capture using orientation fields , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Tao Wang,et al.  The Cluster Hair Model , 2000, Graph. Model..

[24]  Mitsuru Ishizuka,et al.  A system of 3D hair style synthesis based on the wisp model , 1999, The Visual Computer.

[25]  Andrew Selle,et al.  To appear in the ACM SIGGRAPH conference proceedings A Mass Spring Model for Hair Simulation , 2008 .

[26]  Hyeong-Seok Ko,et al.  A statistical wisp model and pseudophysical approaches for interactive hairstyle generation , 2005, IEEE Transactions on Visualization and Computer Graphics.

[27]  Marie-Paule Cani,et al.  A layered wisp model for simulating interactions inside long hair , 2001 .

[28]  Cem Yuksel,et al.  Hair meshes , 2009, SIGGRAPH 2009.

[29]  Yue Qi,et al.  A Lagrange Equations-Based Hair Simulation Method , 2014, 2014 International Conference on Virtual Reality and Visualization.

[30]  Zhan Xu,et al.  V-HairStudio: An Interactive Tool for Hair Design , 2001, IEEE Computer Graphics and Applications.

[31]  Ming C. Lin,et al.  Modeling Hair Influenced by Water and Styling Products , 2004 .

[32]  Marie-Paule Cani,et al.  Realistic Hair from a Sketch , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[33]  Frédo Durand,et al.  Single Photo Estimation of Hair Appearance , 2009 .

[34]  Chongyang Ma,et al.  Single-view hair modeling using a hairstyle database , 2015, ACM Trans. Graph..

[35]  Nuttapong Chentanez,et al.  3D hair model from small set of images , 2016, MIG.

[36]  Frédo Durand,et al.  Hair photobooth , 2008, SIGGRAPH 2008.

[37]  Nakajima Masayuki,et al.  Generation of 3D hair model from 2D image using image processing , 1996, Optics & Photonics.

[38]  Kun Zhou,et al.  High-quality hair modeling from a single portrait photo , 2015, ACM Trans. Graph..

[39]  Joëlle Thollot,et al.  Floating tangents for approximating spatial curves with G1 piecewise helices , 2013, Comput. Aided Geom. Des..

[40]  Yizhou Yu,et al.  Modeling realistic virtual hairstyles , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[41]  Steve Marschner,et al.  A Survey on Hair Modeling: Styling, Simulation, and Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[42]  Kui Wu,et al.  Real-time hair mesh simulation , 2016, I3D.

[43]  Li-Yi Wei,et al.  Capturing braided hairstyles , 2014, ACM Trans. Graph..

[44]  Wenqi Liang,et al.  An enhanced framework for real-time hair animation , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[45]  Shaun Bangay,et al.  Modelling and rendering techniques for African hairstyles , 2004, AFRIGRAPH '04.

[46]  Kun Zhou,et al.  Dynamic hair manipulation in images and videos , 2013, ACM Trans. Graph..

[47]  Bülent Özgüç,et al.  3D Hair sketching for real-time dynamic & key frame animations , 2008, The Visual Computer.

[48]  Kun Zhou,et al.  AutoHair: fully automatic hair modeling from a single image , 2016, ACM Trans. Graph..

[49]  Sylvain Paris,et al.  Capture of hair geometry from multiple images , 2004, ACM Trans. Graph..

[50]  Hao Yang,et al.  A data-driven approach to four-view image-based hair modeling , 2017, ACM Trans. Graph..

[51]  Chongyang Ma,et al.  Robust hair capture using simulated examples , 2014, ACM Trans. Graph..

[52]  Kun Zhou,et al.  A reduced model for interactive hairs , 2014, ACM Trans. Graph..

[53]  Marie-Paule Cani,et al.  Super-helices for predicting the dynamics of natural hair , 2006, ACM Trans. Graph..

[54]  Kun Zhou,et al.  Single-view hair modeling for portrait manipulation , 2012, ACM Trans. Graph..

[55]  Joëlle Thollot,et al.  Stable inverse dynamic curves , 2010, ACM Trans. Graph..

[56]  Wen Tang,et al.  Modelling and animating cartoon hair with NURBS surfaces , 2004, Proceedings Computer Graphics International, 2004..

[57]  Masayuki Nakajima,et al.  Generation of 3d hair model from multiple pictures , 1997 .

[58]  Pierre Poulin,et al.  Capturing the Complexity of Hair Motion , 2002, Graph. Model..

[59]  S. Malik.  A Sketching Interface for Modeling and Editing Hairstyles , 2005, SBM.

[60]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[61]  Kun Zhou,et al.  Example-based hair geometry synthesis , 2009, ACM Trans. Graph..

[62]  Yue Qi,et al.  An adaptive floating tangents fitting with helices method for image-based hair modeling , 2017, CGI.

[63]  Tao Wang,et al.  Hair design based on the hierarchical cluster hair model , 2004 .

[64]  Baining Guo,et al.  Interactive multiresolution hair modeling and editing , 2002, ACM Trans. Graph..

[65]  Florence Bertails-Descoubes,et al.  A hybrid iterative solver for robustly capturing coulomb friction in hair dynamics , 2011, ACM Trans. Graph..

[66]  Hong Chen,et al.  A generative sketch model for human hair analysis and synthesis , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  Marie-Paule Cani,et al.  Predicting Natural Hair Shapes by Solving the Statics of Flexible Rods , 2005, Eurographics.

[68]  Szymon Rusinkiewicz,et al.  Structure-aware hair capture , 2013, ACM Trans. Graph..

[69]  Kun Zhou,et al.  Hair Interpolation for Portrait Morphing , 2013, Comput. Graph. Forum.

[70]  Ken-ichi Anjyo,et al.  Sketchy hairstyles , 2005, International 2005 Computer Graphics.

[71]  Steve Marschner,et al.  Image-Based Hair Capture by Inverse Lighting , 2002, Graphics Interface.

[72]  Yue Qi,et al.  Dynamic hair capture using spacetime optimization , 2014, ACM Trans. Graph..

[73]  Shigeo Morishima,et al.  Hair motion capturing from multiple view videos , 2012, SIGGRAPH '12.

[74]  Ming C. Lin,et al.  Interactive Virtual Hair Salon , 2007, PRESENCE: Teleoperators and Virtual Environments.

[75]  Steve Marschner,et al.  Capturing hair assemblies fiber by fiber , 2009, SIGGRAPH 2009.

[76]  Szymon Rusinkiewicz,et al.  Wide-Baseline Hair Capture Using Strand-Based Refinement , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[77]  Long Quan,et al.  Modeling hair from multiple views , 2005, SIGGRAPH 2005.