A layered, heterogeneous reflectance model for acquiring and rendering human skin

We introduce a layered, heterogeneous spectral reflectance model for human skin. The model captures the inter-scattering of light among layers, each of which may have an independent set of spatially-varying absorption and scattering parameters. For greater physical accuracy and control, we introduce an infinitesimally thin absorbing layer between scattering layers. To obtain parameters for our model, we use a novel acquisition method that begins with multi-spectral photographs. By using an inverse rendering technique, along with known chromophore spectra, we optimize for the best set of parameters for each pixel of a patch. Our method finds close matches to a wide variety of inputs with low residual error. We apply our model to faithfully reproduce the complex variations in skin pigmentation. This is in contrast to most previous work, which assumes that skin is homogeneous or composed of homogeneous layers. We demonstrate the accuracy and flexibility of our model by creating complex skin visual effects such as veins, tattoos, rashes, and freckles, which would be difficult to author using only albedo textures at the skin's outer surface. Also, by varying the parameters to our model, we simulate effects from external forces, such as visible changes in blood flow within the skin due to external pressure.

[1]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[2]  P. Matts,et al.  The distribution of melanin in skin determined in vivo , 2007, The British journal of dermatology.

[3]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[4]  Pieter Peers,et al.  Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination , 2007 .

[5]  Henrik Wann Jensen,et al.  A spectral shading model for human skin , 2006, SIGGRAPH '06.

[6]  Stephen Lin,et al.  Modeling and rendering of quasi-homogeneous materials , 2005, SIGGRAPH 2005.

[7]  Tim Weyrich,et al.  Analysis of human faces using a measurement-based skin reflectance model , 2006, ACM Trans. Graph..

[8]  Craig Donner,et al.  Light diffusion in multi-layered translucent materials , 2005, SIGGRAPH 2005.

[9]  Jos Stam,et al.  An Illumination Model for a Skin Layer Bounded by Rough Surfaces , 2001, Rendering Techniques.

[10]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[11]  Henrik Wann Jensen,et al.  Towards realistic image synthesis of scattering materials , 2006 .

[12]  Andrew Gardner,et al.  Performance relighting and reflectance transformation with time-multiplexed illumination , 2005, SIGGRAPH 2005.

[13]  Henrik Wann Jensen,et al.  A spectral BSSRDF for shading human skin , 2006, EGSR '06.

[14]  T. Fitzpatrick The validity and practicality of sun-reactive skin types I through VI. , 1988, Archives of dermatology.

[15]  Norimichi Tsumura,et al.  Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin , 2003, ACM Trans. Graph..

[16]  Andrew Gardner,et al.  Animatable Facial Reflectance Fields , 2004 .

[17]  H.J.C.M. Sterenborg,et al.  Skin optics , 1989, IEEE Transactions on Biomedical Engineering.

[18]  V. Tuchin Tissue Optics: Light Scattering Methods and Instruments for Medical Diagnosis , 2000 .

[19]  Gladimir V. G. Baranoski,et al.  A Biophysically‐Based Spectral Model of Light Interaction with Human Skin , 2004, Comput. Graph. Forum.

[20]  David J. Kriegman,et al.  Illumination-based image synthesis: creating novel images of human faces under differing pose and lighting , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[21]  Hans-Peter Seidel,et al.  DISCO: acquisition of translucent objects , 2004, ACM Trans. Graph..

[22]  Karl vom Berge,et al.  A compact factored representation of heterogeneous subsurface scattering , 2006, SIGGRAPH 2006.

[23]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[24]  S. Nayar,et al.  The Appearance of Human Skin , 2005 .

[25]  Pat Hanrahan,et al.  Reflection from layered surfaces due to subsurface scattering , 1993, SIGGRAPH.

[26]  Eric Enderton,et al.  Efficient Rendering of Human Skin , 2007 .

[27]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[28]  Christophe Hery Implementing a skin BSSRDF: (or several...) , 2005, SIGGRAPH Courses.

[29]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[30]  Greg Turk,et al.  Efficient Estimation of Spatially Varying Subsurface Scattering Parameters , 2006 .

[31]  Stephen Lin,et al.  Modeling and rendering of heterogeneous translucent materials using the diffusion equation , 2008, TOGS.

[32]  Eric Enderton,et al.  A system for efficient rendering of human skin , 2007, SIGGRAPH '07.

[33]  Henrik Wann Jensen,et al.  A rapid hierarchical rendering technique for translucent materials , 2005, SIGGRAPH Courses.

[34]  Eric F Bernstein,et al.  Laser treatment of tattoos. , 2006, Clinics in dermatology.

[35]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[36]  R. Sayre,et al.  Beta-carotene does not act as an optical filter in skin. , 1992, Journal of photochemistry and photobiology. B, Biology.

[37]  Abhijeet Ghosh,et al.  Practical modeling and acquisition of layered facial reflectance , 2008, SIGGRAPH 2008.

[38]  Kristin J. Dana,et al.  Bidirectional imaging and modeling of skin texture , 2004, IEEE Transactions on Biomedical Engineering.