A Statistical Method for SVBRDF Approximation from Video Sequences in General Lighting Conditions

We present a statistical method for the estimation of the Spatially Varying Bidirectional Reflectance Distribution Function (SVBRDF) of an object with complex geometry, starting from video sequences acquired with fixed but general lighting conditions. The aim of this work is to define a method that simplifies the acquisition phase of the object surface appearance and allows to reconstruct an approximated SVBRDF. The final output is suitable to be used with a 3D model of the object to obtain accurate and photo‐realistic renderings. The method is composed by three steps: the approximation of the environment map of the acquisition scene, using the same object as a probe; the estimation of the diffuse color of the object; the estimation of the specular components of the main materials of the object, by using a Phong model. All the steps are based on statistical analysis of the color samples projected by the video sequences on the surface of the object. Although the method presents some limitations, the trade‐off between the easiness of acquisition and the obtained results makes it useful for practical applications.

[1]  Todd E. Zickler,et al.  Image-based rendering from a sparse set of images , 2005, SIGGRAPH '05.

[2]  Paul E. Debevec,et al.  Digitizing the Parthenon: Estimating Surface Reflectance Properties of a Complex Scene under Captured Natural Illumination , 2004, VMV.

[3]  Pieter Peers,et al.  Estimating Specular Roughness and Anisotropy from Second Order Spherical Gradient Illumination , 2009, Comput. Graph. Forum.

[4]  John M. Snyder,et al.  Manifold bootstrapping for SVBRDF capture , 2010, ACM Trans. Graph..

[5]  Hans-Peter Seidel,et al.  Relighting objects from image collections , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Andrew Gardner,et al.  Linear light source reflectometry , 2003, ACM Trans. Graph..

[7]  Thomas Malzbender,et al.  Polynomial texture maps , 2001, SIGGRAPH.

[8]  Ralf Sarlette,et al.  Acquisition, Synthesis, and Rendering of Bidirectional Texture Functions , 2005, Comput. Graph. Forum.

[9]  Abhijeet Ghosh,et al.  Circularly polarized spherical illumination reflectometry , 2010, SIGGRAPH 2010.

[10]  Steven M. Seitz,et al.  Shape and materials by example: a photometric stereo approach , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Roberto Scopigno,et al.  Geometry-aware Video Registration , 2010, VMV.

[12]  M. Rosenblatt.  Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[13]  Yasuyuki Matsushita,et al.  High-quality shape from multi-view stereo and shading under general illumination , 2011, CVPR 2011.

[14]  Paolo Cignoni,et al.  Masked photo blending: Mapping dense photographic data set on high-resolution sampled 3D models , 2008, Comput. Graph..

[15]  Steven M. Seitz,et al.  Shape and Spatially-Varying BRDFs from Photometric Stereo , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Christopher Schwartz,et al.  Integrated High-Quality Acquisition of Geometry and Appearance for Cultural Heritage , 2011, VAST.

[17]  Jirí Filip,et al.  Bidirectional Texture Function Modeling: A State of the Art Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Adrien Treuille,et al.  Example-Based Stereo with General BRDFs , 2004, ECCV.

[19]  Katsushi Ikeuchi,et al.  Determining Reflectance Parameters and Illumination Distribution from a Sparse Set of Images for View-dependent Image Synthesis , 2001, ICCV.

[20]  David J. Kriegman,et al.  Photometric stereo with non-parametric and spatially-varying reflectance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  John M. Snyder,et al.  Modeling anisotropic surface reflectance with example-based microfacet synthesis , 2008, SIGGRAPH 2008.

[22]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[23]  Ravi Ramamoorthi,et al.  Reflectance sharing: image-based rendering from a sparse set of images , 2005, EGSR '05.

[24]  Todd E. Zickler,et al.  A coaxial optical scanner for synchronous acquisition of 3D geometry and surface reflectance , 2010, SIGGRAPH 2010.

[25]  Tianli Yu,et al.  Sparse lumigraph relighting by illumination and reflectance estimation from multi-view images , 2006, EGSR '06.

[26]  Paul E. Debevec,et al.  Multiview face capture using polarized spherical gradient illumination , 2011, ACM Trans. Graph..

[27]  Shree K. Nayar,et al.  Reflectance and Texture of Real-World Surfaces Authors , 1997, CVPR 1997.

[28]  Hans-Peter Seidel,et al.  Shading-based dynamic shape refinement from multi-view video under general illumination , 2011, 2011 International Conference on Computer Vision.

[29]  Andrew Gardner,et al.  Performance relighting and reflectance transformation with time-multiplexed illumination , 2005, ACM Trans. Graph..

[30]  Pieter Peers,et al.  Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination , 2007 .

[31]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[32]  Pieter Peers,et al.  Circularly polarized spherical illumination reflectometry , 2010, ACM Trans. Graph..

[33]  Paolo Cignoni,et al.  Almost Isometric Mesh Parameterization through Abstract Domains , 2010, IEEE Transactions on Visualization and Computer Graphics.

[34]  Paul E. Debevec,et al.  A median cut algorithm for light probe sampling , 2005, SIGGRAPH Courses.

[35]  Tianli Yu,et al.  Sparse lumigraph relighting by illumination and reflectance estimation from multi-view images , 2006, SIGGRAPH '06.

[36]  Steven M. Seitz,et al.  Shape and spatially-varying BRDFs from photometric stereo , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[37]  Baining Guo,et al.  Pocket reflectometry , 2011, SIGGRAPH 2011.