Dynamic hair manipulation in images and videos

This paper presents a single-view hair modeling technique for generating visually and physically plausible 3D hair models with modest user interaction. By solving an unambiguous 3D vector field explicitly from the image and adopting an iterative hair generation algorithm, we can create hair models that not only visually match the original input very well but also possess physical plausibility (e.g., having strand roots fixed on the scalp and preserving the length and continuity of real strands in the image as much as possible). The latter property enables us to manipulate hair in many new ways that were previously very difficult with a single image, such as dynamic simulation or interactive hair shape editing. We further extend the modeling approach to handle simple video input, and generate dynamic 3D hair models. This allows users to manipulate hair in a video or transfer styles from images to videos.

[1]  Wojciech Matusik,et al.  Video face replacement , 2011, ACM Trans. Graph..

[2]  Cem Yuksel,et al.  Hair meshes , 2009, SIGGRAPH 2009.

[3]  Kaleem Siddiqi,et al.  Generalized Helicoids for Modeling Hair Geometry , 2011, Comput. Graph. Forum.

[4]  Hanspeter Pfister,et al.  Face transfer with multilinear models , 2005, SIGGRAPH 2005.

[5]  Shree K. Nayar,et al.  Face swapping: automatically replacing faces in photographs , 2008, SIGGRAPH 2008.

[6]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[7]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[8]  Steve Marschner,et al.  A Survey on Hair Modeling: Styling, Simulation, and Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[9]  Florence Bertails-Descoubes,et al.  A hybrid iterative solver for robustly capturing coulomb friction in hair dynamics , 2011, ACM Trans. Graph..

[10]  Long Quan,et al.  Sketching hairstyles , 2007, SBIM '07.

[11]  D. Cohen-Or,et al.  Parametric reshaping of human bodies in images , 2010, ACM Trans. Graph..

[12]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[13]  Frédo Durand,et al.  Single Photo Estimation of Hair Appearance , 2009 .

[14]  Fei Yang,et al.  Expression flow for 3D-aware face component transfer , 2011, SIGGRAPH 2011.

[15]  Baining Guo,et al.  Example-based hair geometry synthesis , 2009, SIGGRAPH 2009.

[16]  Markus Gross,et al.  Practical temporal consistency for image-based graphics applications , 2012, ACM Trans. Graph..

[17]  Szymon Rusinkiewicz,et al.  Multi-view hair capture using orientation fields , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  P. Hanrahan,et al.  Light Scattering from Human Hair Fibers , 2003 .

[19]  JinXiaogang,et al.  Dynamic hair manipulation in images and videos , 2013 .

[20]  Kun Zhou,et al.  Example-based hair geometry synthesis , 2009, ACM Trans. Graph..

[21]  Andrew Selle,et al.  To appear in the ACM SIGGRAPH conference proceedings A Mass Spring Model for Hair Simulation , 2008 .

[22]  Hans-Peter Seidel,et al.  MovieReshape: tracking and reshaping of humans in videos , 2010, ACM Trans. Graph..

[23]  Kun Zhou,et al.  Single-view hair modeling for portrait manipulation , 2012, ACM Trans. Graph..

[24]  Ken Perlin,et al.  Improving noise , 2002, SIGGRAPH.

[25]  Jianxiong Xiao,et al.  Single image tree modeling , 2008, SIGGRAPH 2008.

[26]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[27]  Eyal Ofek,et al.  Video-Based Modeling of Dynamic Hair , 2009, PSIVT.

[28]  David A. Forsyth,et al.  Rendering synthetic objects into legacy photographs , 2011, ACM Trans. Graph..

[29]  Steve Marschner,et al.  Capturing hair assemblies fiber by fiber , 2009, SIGGRAPH 2009.

[30]  Long Quan,et al.  Modeling hair from multiple views , 2005, SIGGRAPH 2005.

[31]  Kun Zhou,et al.  Interactive images , 2012, ACM Trans. Graph..

[32]  Arno Zinke,et al.  Lighting hair from the inside , 2012, ACM Trans. Graph..

[33]  Heung-Yeung Shum,et al.  Paint selection , 2009, SIGGRAPH 2009.

[34]  Paul A. Beardsley,et al.  Coupled 3D reconstruction of sparse facial hair and skin , 2012, ACM Trans. Graph..

[35]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, SIGGRAPH 2005.

[36]  Sylvain Paris,et al.  Capture of hair geometry from multiple images , 2004, ACM Trans. Graph..

[37]  Frédo Durand,et al.  Hair photobooth , 2008, SIGGRAPH 2008.

[38]  Huamin Wang,et al.  Simulation Guided Hair Dynamics Modeling from Video , 2012, Comput. Graph. Forum.