A layered, heterogeneous reflectance model for acquiring and rendering human skin

We introduce a layered, heterogeneous spectral reflectance model for human skin. The model captures the inter-scattering of light among layers, each of which may have an independent set of spatially-varying absorption and scattering parameters. For greater physical accuracy and control, we introduce an infinitesimally thin absorbing layer between scattering layers. To obtain parameters for our model, we use a novel acquisition method that begins with multi-spectral photographs. By using an inverse rendering technique, along with known chromophore spectra, we optimize for the best set of parameters for each pixel of a patch. Our method finds close matches to a wide variety of inputs with low residual error. We apply our model to faithfully reproduce the complex variations in skin pigmentation. This is in contrast to most previous work, which assumes that skin is homogeneous or composed of homogeneous layers. We demonstrate the accuracy and flexibility of our model by creating complex skin visual effects such as veins, tattoos, rashes, and freckles, which would be difficult to author using only albedo textures at the skin's outer surface. Also, by varying the parameters to our model, we simulate effects from external forces, such as visible changes in blood flow within the skin due to external pressure.

[1]  Henrik Wann Jensen,et al.  Towards realistic image synthesis of scattering materials , 2006 .

[2]  Stephen Lin,et al.  Modeling and rendering of quasi-homogeneous materials , 2005, ACM Trans. Graph..

[3]  Stephen Lin,et al.  Modeling and rendering of heterogeneous translucent materials using the diffusion equation , 2008, TOGS.

[4]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[5]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[6]  Eric F Bernstein,et al.  Laser treatment of tattoos. , 2006, Clinics in dermatology.

[7]  David J. Kriegman,et al.  Illumination-based image synthesis: creating novel images of human faces under differing pose and lighting , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[8]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  E. Claridge,et al.  A skin imaging method based on a colour formation model and its application to the diagnosis of pigmented skin lesions , 2002 .

[10]  P. Matts,et al.  The distribution of melanin in skin determined in vivo , 2007, The British journal of dermatology.

[11]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[12]  Hans-Peter Seidel,et al.  DISCO: acquisition of translucent objects , 2004, ACM Trans. Graph..

[13]  Karl vom Berge,et al.  A compact factored representation of heterogeneous subsurface scattering , 2006, SIGGRAPH 2006.

[14]  Jos Stam,et al.  An Illumination Model for a Skin Layer Bounded by Rough Surfaces , 2001, Rendering Techniques.

[15]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[16]  Andrew Gardner,et al.  Performance relighting and reflectance transformation with time-multiplexed illumination , 2005, ACM Trans. Graph..

[17]  Eric Enderton,et al.  Efficient Rendering of Human Skin , 2007 .

[18]  R. Sayre,et al.  Beta-carotene does not act as an optical filter in skin. , 1992, Journal of photochemistry and photobiology. B, Biology.

[19]  Kristin J. Dana,et al.  Bidirectional imaging and modeling of skin texture , 2004, IEEE Transactions on Biomedical Engineering.

[20]  S. Nayar,et al.  The Appearance of Human Skin , 2005 .

[21]  Pat Hanrahan,et al.  Reflection from layered surfaces due to subsurface scattering , 1993, SIGGRAPH.

[22]  Tim Weyrich,et al.  A layered, heterogeneous reflectance model for acquiring and rendering human skin , 2008, SIGGRAPH 2008.

[23]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[24]  Christophe Hery Implementing a skin BSSRDF: (or several...) , 2005, SIGGRAPH Courses.

[25]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[26]  M. Gross,et al.  Analysis of human faces using a measurement-based skin reflectance model , 2006, ACM Trans. Graph..

[27]  H.J.C.M. Sterenborg,et al.  Skin optics , 1989, IEEE Transactions on Biomedical Engineering.

[28]  V. Tuchin Tissue Optics: Light Scattering Methods and Instruments for Medical Diagnosis , 2000 .

[29]  Norimichi Tsumura,et al.  Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin , 2003, ACM Trans. Graph..

[30]  Andrew Gardner,et al.  Animatable Facial Reflectance Fields , 2004 .

[31]  Henrik Wann Jensen,et al.  A rapid hierarchical rendering technique for translucent materials , 2005, SIGGRAPH Courses.

[32]  Pieter Peers,et al.  Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination , 2007 .

[33]  P. Debevec,et al.  Practical modeling and acquisition of layered facial reflectance , 2008, SIGGRAPH Asia '08.

[34]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[35]  Henrik Wann Jensen,et al.  A spectral BSSRDF for shading human skin , 2006, EGSR '06.

[36]  T. Fitzpatrick The validity and practicality of sun-reactive skin types I through VI. , 1988, Archives of dermatology.

[37]  Gladimir V. G. Baranoski,et al.  A Biophysically‐Based Spectral Model of Light Interaction with Human Skin , 2004, Comput. Graph. Forum.

[38]  Greg Turk,et al.  Efficient Estimation of Spatially Varying Subsurface Scattering Parameters , 2006 .

[39]  Henrik Wann Jensen,et al.  Light diffusion in multi-layered translucent materials , 2005, ACM Trans. Graph..