A vivid visual emotion synthesis system: From face to hair

A visual emotional synthesis system is proposed. Firstly, facial expression is synthesized by the anatomical model and parameterized model. Secondly, cartoonish hairstyle is synthesized to describe emotion implicitly by the mass-spring model and cantilever beam model. Finally, the synthesis results of facial expression and hairstyle are combined to produce a complete visual emotion synthesis result. Experiment results demonstrate the proposed system can synthesize realistic animation, and the emotion expressiveness by combining of face and hair outperform that by face or hair alone.

[1]  Eduardo Zalama Casanova,et al.  A realistic facial animation suitable for human-robot interfacing , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Keith Waters,et al.  Computer facial animation , 1996 .

[3]  Ronald Fedkiw,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2006) Simulating Speech with a Physics-based Facial Muscle Model , 2022 .

[4]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, SIGGRAPH '05.

[5]  Kun Zhou,et al.  Single-view hair modeling for portrait manipulation , 2012, ACM Trans. Graph..

[6]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[7]  Kun Zhou,et al.  High-quality hair modeling from a single portrait photo , 2015, ACM Trans. Graph..

[8]  Andrew Selle,et al.  To appear in the ACM SIGGRAPH conference proceedings A Mass Spring Model for Hair Simulation , 2008 .

[9]  Pheng-Ann Heng,et al.  A Physically-Based Modeling and Simulation Framework for Facial Animation , 2009, 2009 Fifth International Conference on Image and Graphics.

[10]  Sylvain Paris,et al.  Capture of hair geometry from multiple images , 2004, ACM Trans. Graph..

[11]  Harry Shum,et al.  Modeling hair from multiple views , 2005, ACM Trans. Graph..

[12]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[13]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[14]  Frédo Durand,et al.  Single Photo Estimation of Hair Appearance , 2009 .

[15]  Peter Eisert,et al.  MPEG‐4 facial animation in video analysis and synthesis , 2003, Int. J. Imaging Syst. Technol..

[16]  M. Bro-Nielsen,et al.  Finite element modeling in surgery simulation , 1998, Proc. IEEE.

[17]  Ken-ichi Anjyo,et al.  A simple method for extracting the natural beauty of hair , 1992, SIGGRAPH.

[18]  Kun Zhou,et al.  A reduced model for interactive hairs , 2014, ACM Trans. Graph..

[19]  Jun Yu,et al.  A Video, Text, and Speech-Driven Realistic 3-D Virtual Head for Human–Machine Interface , 2015, IEEE Transactions on Cybernetics.

[20]  Tomaso A. Poggio,et al.  Reanimating Faces in Images and Video , 2003, Comput. Graph. Forum.

[21]  Marie-Paule Cani,et al.  Super-helices for predicting the dynamics of natural hair , 2006, SIGGRAPH 2006.

[22]  Byung-Uck Kim,et al.  A deformation transformer for real-time cloth animation , 2010, ACM Trans. Graph..

[23]  Brian Wyvill,et al.  Robust iso-surface tracking for interactive character skinning , 2014, ACM Trans. Graph..

[24]  Markus H. Gross,et al.  Simulating facial surgery using finite element models , 1996, SIGGRAPH.