BSSRDF Estimation from Single Images

We present a novel method to estimate an approximation of the reflectance characteristics of optically thick, homogeneous translucent materials using only a single photograph as input. First, we approximate the diffusion profile as a linear combination of piecewise constant functions, an approach that enables a linear system minimization and maximizes robustness in the presence of suboptimal input data inferred from the image. We then fit to a smoother monotonically decreasing model, ensuring continuity on its first derivative. We show the feasibility of our approach and validate it in controlled environments, comparing well against physical measurements from previous works. Next, we explore the performance of our method in uncontrolled scenarios, where neither lighting nor geometry are known. We show that these can be roughly approximated from the corresponding image by making two simple assumptions: that the object is lit by a distant light source and that it is globally convex, allowing us to capture the visual appearance of the photographed material. Compared with previous works, our technique offers an attractive balance between visual accuracy and ease of use, allowing its use in a wide range of scenarios including off‐the‐shelf, single images, thus extending the current repertoire of real‐world data acquisition techniques.

[1]  Yee-Hong Yang,et al.  Multiple Illuminant Direction Detection with Application to Image Synthesis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Erik Reinhard,et al.  Compositing images through light source detection , 2010, Comput. Graph..

[3]  Yasushi Yagi,et al.  Analysis of Subsurface Scattering Based on Dipole Approximation , 2009, IPSJ Trans. Comput. Vis. Appl..

[4]  Tai-Pang Wu,et al.  Separating Subsurface Scattering from Photometric Image , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[5]  Pieter Peers,et al.  SubEdit: a representation for editing measured heterogeneous subsurface scattering , 2009, ACM Trans. Graph..

[6]  Pieter Peers,et al.  Practical modeling and acquisition of layered facial reflectance , 2008, SIGGRAPH Asia '08.

[7]  Adam Finkelstein Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering , 2002 .

[8]  Julie Dorsey,et al.  Digital Modeling of Material Appearance , 2007 .

[9]  Greg Turk,et al.  Efficient Estimation of Spatially Varying Subsurface Scattering Parameters , 2006 .

[10]  H. Bülthoff,et al.  Depth Discrimination from Shading under Diffuse Lighting , 2000, Perception.

[11]  Pieter Peers,et al.  A compact factored representation of heterogeneous subsurface scattering , 2006, ACM Trans. Graph..

[12]  Tim Weyrich,et al.  Principles of appearance acquisition and representation , 2007, SIGGRAPH '08.

[13]  M. Gross,et al.  Analysis of human faces using a measurement-based skin reflectance model , 2006, ACM Trans. Graph..

[14]  Diego Gutierrez,et al.  SINGLE-IMAGE APPEARANCE ACQUISITION USING GENETIC ALGORITHMS , 2009 .

[15]  Erik Reinhard,et al.  Image-based material editing , 2005, SIGGRAPH '05.

[16]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[17]  Peter-Pike J. Sloan,et al.  The Lit Sphere: A Model for Capturing NPR Shading from Art , 2001, Graphics Interface.

[18]  Yang Wang,et al.  Estimation of Multiple Illuminants from a Single Image of Arbitrary Known Geometry , 2002, ECCV.

[19]  Richard Barrett,et al.  Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 1994, Other Titles in Applied Mathematics.

[20]  Veronica Sundstedt,et al.  Measuring the perception of light inconsistencies , 2010, APGV '10.

[21]  Henrik Wann Jensen,et al.  A rapid hierarchical rendering technique for translucent materials , 2005, ACM Trans. Graph..

[22]  Hans-Peter Seidel,et al.  DISCO: acquisition of translucent objects , 2004, ACM Trans. Graph..

[23]  Henrik Wann Jensen,et al.  A rapid hierarchical rendering technique for translucent materials , 2005, SIGGRAPH Courses.

[24]  Stephen Lin,et al.  Modeling and rendering of heterogeneous translucent materials using the diffusion equation , 2008, TOGS.

[25]  Erik Reinhard,et al.  Depicting procedural caustics in single images , 2008, SIGGRAPH Asia '08.

[26]  Yue Gao,et al.  Real‐time homogenous translucent material editing , 2007, Comput. Graph. Forum.

[27]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[28]  Marc Stamminger,et al.  Translucent Shadow Maps , 2003, Rendering Techniques.

[29]  Tim Weyrich,et al.  A layered, heterogeneous reflectance model for acquiring and rendering human skin , 2008, SIGGRAPH Asia '08.

[30]  Heinrich H. Bülthoff,et al.  Low-Level Image Cues in the Perception of Translucent Materials , 2005, TAP.

[31]  Eric Enderton,et al.  Efficient Rendering of Human Skin , 2007 .

[32]  Erik Reinhard,et al.  Image-based material editing , 2005, SIGGRAPH '05.

[33]  André Gagalowicz,et al.  Image-based rendering of diffuse, specular and glossy surfaces from a single image , 2001, SIGGRAPH.

[34]  Scott F. Johnston Lumo: illumination for cel animation , 2002, NPAR '02.

[35]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[36]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, SIGGRAPH 2006.

[37]  Karl vom Berge,et al.  A compact factored representation of heterogeneous subsurface scattering , 2006, SIGGRAPH 2006.

[38]  Haruo Takemura,et al.  Spatial Reflectance Recovery under Complex Illumination from Sparse Images , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).