Realistic Facial Expression of Virtual Human Based on Color, Sweat, and Tears Effects

Generating extreme appearances such as scared awaiting sweating while happy fit for tears (cry) and blushing (anger and happiness) is the key issue in achieving the high quality facial animation. The effects of sweat, tears, and colors are integrated into a single animation model to create realistic facial expressions of 3D avatar. The physical properties of muscles, emotions, or the fluid properties with sweating and tears initiators are incorporated. The action units (AUs) of facial action coding system are merged with autonomous AUs to create expressions including sadness, anger with blushing, happiness with blushing, and fear. Fluid effects such as sweat and tears are simulated using the particle system and smoothed-particle hydrodynamics (SPH) methods which are combined with facial animation technique to produce complex facial expressions. The effects of oxygenation of the facial skin color appearance are measured using the pulse oximeter system and the 3D skin analyzer. The result shows that virtual human facial expression is enhanced by mimicking actual sweating and tears simulations for all extreme expressions. The proposed method has contribution towards the development of facial animation industry and game as well as computer graphics.

[1]  I. McGregor,et al.  The sweating reactions of the forehead , 1952, The Journal of physiology.

[2]  F. Fay Evans-Martin.  Emotion and Stress , 2007 .

[3]  ANIMAL VOCAL COMMUNICATION: A NEW APPROACH , 2000 .

[4]  Jeremy N. Bailenson,et al.  A meta-analysis of the impact of the inclusion and realism of human-like faces on user experiences in interfaces , 2007, CHI.

[5]  Jonathan Gratch,et al.  Expression of Emotions Using Wrinkles, Blushing, Sweating and Tears , 2009, IVA.

[6]  Keith Waters,et al.  Computer facial animation , 1996 .

[7]  J. S. Efran,et al.  A Two-Factor Theory and Evidence from The Miracle Worker , 1979 .

[8]  D. Perrett,et al.  Skin Blood Perfusion and Oxygenation Colour Affect Perceived Human Health , 2009, PloS one.

[9]  M. Liebowitz,et al.  Functional impairment in social phobia. , 1994, The Journal of clinical psychiatry.

[10]  W. Schill,et al.  [Fox-Fordyce disease (apocrine miliaria)]. , 1993, Der Hautarzt; Zeitschrift fur Dermatologie, Venerologie, und verwandte Gebiete.

[11]  W. Shelley,et al.  Apocrine sweat retention in man. II. Fox-Fordyce disease (apocrine miliaria). , 1956, A.M.A. archives of dermatology.

[12]  Henrik Wann Jensen,et al.  A spectral BSSRDF for shading human skin , 2006, EGSR '06.

[13]  Feng Dong,et al.  Building highly realistic facial modeling and animation: a survey , 2007, The Visual Computer.

[14]  K. Bard,et al.  A Cross-species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS) , 2007, Journal of nonverbal behavior.

[15]  Ahmad Hoirul Basori,et al.  The effect of emotional colour on creating realistic expression of avatar , 2012, VRCAI '12.

[16]  J. Nelson,et al.  The Meaning of Crying Based on Attachment Theory , 1998 .

[17]  Luc Renambot,et al.  Designing an Expressive Avatar of a Real Person , 2010, IVA.

[18]  Verónica Orvalho,et al.  A practical appearance model for dynamic facial color , 2010, SIGGRAPH 2010.

[19]  Arjan Egges,et al.  Real-Time Crying Simulation , 2009, IVA.

[20]  Henrik Wann Jensen,et al.  Light diffusion in multi-layered translucent materials , 2005, ACM Trans. Graph..

[21]  C. Castelfranchi,et al.  Crying: discussing its basic reasons and uses , 2003 .

[22]  Ross T. Whitaker,et al.  Particle‐Based Simulation of Fluids , 2003, Comput. Graph. Forum.

[23]  H. Hurley,et al.  Apocrine Sweat Retention in Man , 1954 .

[24]  Diego Gutierrez,et al.  A practical appearance model for dynamic facial color , 2010, ACM Trans. Graph..

[25]  P. Ekman,et al.  Detecting deception from the body or face. , 1974 .

[26]  J-F Gerbeau,et al.  External tissue support and fluid–structure simulation in blood flows , 2012, Biomechanics and modeling in mechanobiology.

[27]  Norman I. Badler,et al.  Creating Interactive Virtual Humans: Some Assembly Required , 2002, IEEE Intell. Syst..

[28]  Nadia Magnenat-Thalmann,et al.  DESIGNING MPEG-4 FACIAL ANIMATION TABLES FOR WEB APPLICATIONS , 2001 .

[29]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[30]  Chen Liu,et al.  AN ANALYSIS OF THE CURRENT AND FUTURE STATE OF 3D FACIAL ANIMATION TECHNIQUES AND SYSTEMS , 2009 .

[31]  Mel Slater,et al.  The Impact of Avatar Blushing on the Duration of Interaction between a Real and Virtual Person , 2008 .

[32]  D. Stanomir,et al.  Circular Interpolation for Morphing 3D Facial Animations , 2012 .

[33]  R. Levenson,et al.  Autonomic specificity and emotion. , 2003 .

[34]  Nadia Magnenat-Thalmann,et al.  Emotional Communicative Body Animation for Multiple Characters , 2005 .

[35]  Ruchika Lamba,et al.  Automatic Face Detection Using Color Based Segmentation , 2012 .

[36]  R. Gur,et al.  Automated Facial Action Coding System for dynamic analysis of facial expressions in neuropsychiatric disorders , 2011, Journal of Neuroscience Methods.

[37]  J. S. Efran,et al.  Why grown-ups cry , 1979 .

[38]  Robert Bridson,et al.  Fluid simulation: SIGGRAPH 2007 course notesVideo files associated with this course are available from the citation page , 2007, SIGGRAPH Courses.

[39]  Zhiwei Zhu,et al.  Dynamic Facial Expression Analysis and Synthesis With MPEG-4 Facial Animation Parameters , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Maja Pantic,et al.  Fully Automatic Facial Action Unit Detection and Temporal Analysis , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[41]  J. Krebs,et al.  Behavioural Ecology: An Evolutionary Approach , 1978 .

[42]  P. Deuflhard,et al.  Anatomy- and physics-based facial animation for craniofacial surgery simulations , 2004, Medical and Biological Engineering and Computing.

[43]  Jagadeesh Pujari,et al.  Face detection system using HSV color model and morphing operations , 2013 .