A practical appearance model for dynamic facial color

Facial appearance depends on both the physical and physiological state of the skin. As people move, talk, undergo stress, and change expression, skin appearance is in constant flux. One of the key indicators of these changes is the color of skin. Skin color is determined by scattering and absorption of light within the skin layers, caused mostly by concentrations of two chromophores, melanin and hemoglobin. In this paper we present a real-time dynamic appearance model of skin built from in vivo measurements of melanin and hemoglobin concentrations. We demonstrate an efficient implementation of our method, and show that it adds negligible overhead to existing animation and rendering pipelines. Additionally, we develop a realistic, intuitive, and automatic control for skin color, which we term a skin appearance rig. This rig can easily be coupled with a traditional geometric facial animation rig. We demonstrate our method by augmenting digital facial performance with realistic appearance changes.

[1]  R. Anderson,et al.  The optics of human skin. , 1981, The Journal of investigative dermatology.

[2]  Norimichi Tsumura,et al.  Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin , 2003, ACM Trans. Graph..

[3]  Diego Gutierrez,et al.  Screen-space perceptual rendering of human skin , 2009, TAP.

[4]  Henrik Wann Jensen,et al.  A spectral shading model for human skin , 2006, SIGGRAPH '06.

[5]  Zhigang Deng,et al.  Animating blendshape faces by cross-mapping motion capture data , 2006, I3D '06.

[6]  Mark Sagar.  Facial performance capture and expressive translation for King Kong , 2006, SIGGRAPH Sketches.

[7]  Eric Enderton,et al.  Efficient Rendering of Human Skin , 2007 .

[8]  Daniel G. Aliaga,et al.  Dense Depth and Color Acquisition of Repetitive Motions , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[9]  C. Huh,et al.  Time course of ultraviolet‐induced skin reactions evaluated by two different reflectance spectrophotometers: DermaSpectrophotometer® and Minolta spectrophotometer CM‐2002® , 2002, Photodermatology, photoimmunology & photomedicine.

[10]  Anthony Ward.  Game character development with Maya , 2004 .

[11]  R. Plutchik.  A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION , 1980 .

[12]  Jonathan Gratch,et al.  Expression of Emotions Using Wrinkles, Blushing, Sweating and Tears , 2009, IVA.

[13]  P. Matts,et al.  The distribution of melanin in skin determined in vivo , 2007, The British journal of dermatology.

[14]  H. Mescon,et al.  Vascular patterns in the skin of the face. , 1959, The Journal of investigative dermatology.

[15]  Nadia Magnenat-Thalmann,et al.  Modeling of vascular expressions in facial animation , 1994, Proceedings of Computer Animation '94.

[16]  P. Ekman.  Universals and cultural differences in facial expressions of emotion. , 1972 .

[17]  Takashi Yamada,et al.  Virtual Facial Image Synthesis with Facial Color Enhancement and Expression under Emotional Change ofAnger , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[18]  Diego Gutierrez,et al.  Real-Time Realistic Skin Translucency , 2010, IEEE Computer Graphics and Applications.

[19]  Kristin J. Dana,et al.  Bidirectional imaging and modeling of skin texture , 2004, IEEE Transactions on Biomedical Engineering.

[20]  T. Ryan,et al.  Mechanical resilience of skin: a function of blood supply and lymphatic drainage. , 1995, Clinics in dermatology.

[21]  Abhijeet Ghosh,et al.  Practical modeling and acquisition of layered facial reflectance , 2008, SIGGRAPH 2008.

[22]  Norimichi Tsumura,et al.  Independent Component Analysis of Skin Color Image , 1998, CIC.

[23]  Feng Dong,et al.  Building highly realistic facial modeling and animation: a survey , 2007, The Visual Computer.

[24]  Tim Weyrich,et al.  A layered, heterogeneous reflectance model for acquiring and rendering human skin , 2008, SIGGRAPH 2008.

[25]  Kristin J. Dana,et al.  Skin Texture Modeling , 2005, International Journal of Computer Vision.

[26]  Derek Bradley,et al.  High resolution passive facial performance capture , 2010, SIGGRAPH 2010.

[27]  Antony Ward.  Game Character Development with Maya (New Riders Games) , 2004 .

[28]  Csaba Kelemen,et al.  A Microfacet Based Coupled Specular-Matte BRDF Model with Importance Sampling , 2001, Eurographics.

[29]  P. Matts,et al.  New insights into skin appearance and measurement. , 2008, The journal of investigative dermatology. Symposium proceedings.

[30]  David S. Goldstein,et al.  Adrenaline and the Inner World: An Introduction to Scientific Integrative Medicine , 2006 .

[31]  Christian Knöpfle,et al.  Dynamic aspects of real-time face-rendering , 2006, VRST '06.

[32]  Ela Claridge,et al.  Developing a predictive model of human skin coloring , 1996, Medical Imaging.

[33]  Eric Enderton,et al.  A system for efficient rendering of human skin , 2007, SIGGRAPH '07.

[34]  Tim Weyrich,et al.  Analysis of human faces using a measurement-based skin reflectance model , 2006, ACM Trans. Graph..

[35]  Dong Guo,et al.  Digital face makeup by example , 2009, CVPR.

[36]  F. Durand,et al.  Texture design using a simplicial complex of morphable textures , 2005, SIGGRAPH 2005.

[37]  Jens Keil,et al.  Real-Time Rendering of Skin Changes Caused by Emotions , 2009, IVA.

[38]  Henrik Wann Jensen,et al.  A spectral BSSRDF for shading human skin , 2006, EGSR '06.