Practical modeling and acquisition of layered facial reflectance

We present a practical method for modeling layered facial reflectance consisting of specular reflectance, single scattering, and shallow and deep subsurface scattering. We estimate parameters of appropriate reflectance models for each of these layers from just 20 photographs recorded in a few seconds from a single viewpoint. We extract spatially-varying specular reflectance and single-scattering parameters from polarization-difference images under spherical and point source illumination. Next, we employ direct-indirect separation to decompose the remaining multiple scattering observed under cross-polarization into shallow and deep scattering components to model the light transport through multiple layers of skin. Finally, we match appropriate diffusion models to the extracted shallow and deep scattering components for different regions on the face. We validate our technique by comparing renderings of subjects to reference photographs recorded from novel viewpoints and under novel illumination conditions.

[1]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[2]  Robert J. Woodham,et al.  Photometric Stereo: A Reflectance Map Technique For Determining Surface Orientation From Image Intensity , 1979, Optics & Photonics.

[3]  Pat Hanrahan,et al.  Reflection from layered surfaces due to subsurface scattering , 1993, SIGGRAPH.

[4]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[5]  David J. Kriegman,et al.  Illumination-based image synthesis: creating novel images of human faces under differing pose and lighting , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[6]  V. Tuchin.  Tissue Optics: Light Scattering Methods and Instruments for Medical Diagnosis , 2000 .

[7]  Steve Marschner,et al.  Modeling and Rendering for Realistic Facial Animation , 2000, Rendering Techniques.

[8]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[9]  Peter Shirley,et al.  A microfacet-based BRDF generator , 2000, SIGGRAPH.

[10]  S Morgan,et al.  Polarization properties of light backscattered from a two layer scattering medium. , 2000, Optics express.

[11]  H. Jensen.  Realistic Image Synthesis Using Photon Mapping , 2001 .

[12]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[13]  Athinodoros S. Georghiades,et al.  Recovering 3-D Shape and Reflectance From a Small Number of Photographs , 2003, Rendering Techniques.

[14]  Jan J. Koenderink,et al.  The secret of velvety skin , 2003, Machine Vision and Applications.

[15]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[16]  Hans-Peter Seidel,et al.  DISCO: acquisition of translucent objects , 2004, ACM Trans. Graph..

[17]  Hans-Peter Seidel,et al.  Reflectance from images: a model-based approach for human faces , 2005, IEEE Transactions on Visualization and Computer Graphics.

[18]  Henrik Wann Jensen,et al.  Light diffusion in multi-layered translucent materials , 2005, ACM Trans. Graph..

[19]  Stephen Lin,et al.  Modeling and rendering of quasi-homogeneous materials , 2005, ACM Trans. Graph..

[20]  Christophe Hery.  Implementing a skin BSSRDF: (or several...) , 2005, SIGGRAPH Courses.

[21]  Ravi Ramamoorthi,et al.  Reflectance sharing: predicting appearance from a sparse set of images of a known shape , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Henrik Wann Jensen,et al.  A spectral BSSRDF for shading human skin , 2006, EGSR '06.

[23]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, ACM Trans. Graph..

[24]  M. Gross,et al.  Analysis of human faces using a measurement-based skin reflectance model , 2006, ACM Trans. Graph..

[25]  Karl vom Berge,et al.  A compact factored representation of heterogeneous subsurface scattering , 2006, SIGGRAPH 2006.

[26]  Greg Turk,et al.  Efficient Estimation of Spatially Varying Subsurface Scattering Parameters , 2006 .

[27]  Pieter Peers,et al.  Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination , 2007 .

[28]  Eric Enderton,et al.  Efficient Rendering of Human Skin , 2007 .

[29]  M. Ashikhmin,et al.  Distribution-based BRDFs , 2007 .

[30]  Stephen Lin,et al.  Modeling and rendering of heterogeneous translucent materials using the diffusion equation , 2008, TOGS.

[31]  Abhijeet Ghosh,et al.  Practical modeling and acquisition of layered facial reflectance , 2008, SIGGRAPH 2008.

[32]  Tim Weyrich,et al.  A layered, heterogeneous reflectance model for acquiring and rendering human skin , 2008, SIGGRAPH Asia '08.