Data-driven Enhancement of SVBRDF Reflectance Data

Analytical SVBRDF representations are widely used to represent spatially varying material appearance depending on view and light configurations. State-of-the-art industry-grade SVBRDF acquisition devices allow the acquisition within several minutes. For many materials with a surface reflectance behavior exhibiting complex effects of light exchange such as inter-reflections, self-occlusions or local subsurface scattering, SVBRDFs cannot accurately capture material appearance. We therefore propose a method to transform SVBRDF acquisition devices to full BTF acquisition devices. To this end, we use data-driven linear models obtained from a database of BTFs captured with a traditional BTF acquisition device in order to reconstruct high-resolution BTFs from the SVBRDF acquisition devices’ sparse measurements. We deal with the high degree of sparsity using Tikhonov regularization. In our evaluation, we validate our approach on several materials and show that BTF-like material appearance can be generated from SVBRDF measurements in the range

[1]  Jaakko Lehtinen,et al.  Reflectance modeling by neural texture synthesis , 2016, ACM Trans. Graph..

[2]  Xin Du,et al.  Spectral bidirectional texture function reconstruction by fusing multiple-color and spectral images. , 2016, Applied optics.

[3]  Didier Stricker,et al.  Faithful, compact and complete digitization of cultural heritage using a full-spherical scanner , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[4]  Wojciech Matusik,et al.  Efficient Isotropic BRDF Measurement , 2003, Rendering Techniques.

[5]  Michael Weinmann,et al.  Linear Models for Material BTFs and Possible Applications , 2015, Material Appearance Modeling.

[6]  Ralf Sarlette,et al.  Acquisition, Synthesis, and Rendering of Bidirectional Texture Functions , 2005, Comput. Graph. Forum.

[7]  Jirí Filip,et al.  Bidirectional Texture Function Modeling: A State of the Art Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jirí Filip,et al.  Minimal Sampling for Effective Acquisition of Anisotropic BRDFs , 2016, Comput. Graph. Forum.

[9]  Christopher Schwartz,et al.  DOME II: A Parallelized BTF Acquisition System , 2013, Material Appearance Modeling.

[10]  Christopher Schwartz,et al.  Design and Implementation of Practical Bidirectional Texture Function Measurement Devices Focusing on the Developments at the University of Bonn , 2014, Sensors.

[11]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[12]  Aswin C. Sankaranarayanan,et al.  A Dictionary-Based Approach for Estimating Shape and Spatially-Varying Reflectance , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[13]  Jaakko Lehtinen,et al.  Two-shot SVBRDF capture for stationary materials , 2015, ACM Trans. Graph..

[14]  Vlastimil Havran,et al.  BRDF Slices: Accurate Adaptive Anisotropic Appearance Acquisition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Hans-Peter Seidel,et al.  Image-Based Reconstruction of Spatially Varying Materials , 2001 .

[16]  Jaakko Lehtinen,et al.  Practical SVBRDF capture in the frequency domain , 2013, ACM Trans. Graph..

[17]  Jannik Boll Nielsen,et al.  On optimal, minimal BRDF sampling for reflectance acquisition , 2015, ACM Trans. Graph..

[18]  M. Gross,et al.  Analysis of human faces using a measurement-based skin reflectance model , 2006, ACM Trans. Graph..

[19]  Jason Lawrence,et al.  A coaxial optical scanner for synchronous acquisition of 3D geometry and surface reflectance , 2010, ACM Transactions on Graphics.

[20]  Reinhard Klein,et al.  Patch-based sparse reconstruction of material BTFs. , 2014 .

[21]  Michal Haindl,et al.  Visual Texture: Accurate Material Appearance Measurement, Representation and Modeling , 2013 .

[22]  Wojciech Matusik,et al.  Acquisition and Rendering of Transparent and Refractive Objects , 2002, Rendering Techniques.

[23]  Jannik Boll Nielsen,et al.  Minimal BRDF sampling for two-shot near-field reflectance acquisition , 2016, ACM Trans. Graph..

[24]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[25]  Reinhard Klein,et al.  Acquiring Bidirectional Texture Functions for Large-Scale Material Samples , 2014 .

[26]  Shree K. Nayar,et al.  Reflectance and Texture of Real-World Surfaces Authors , 1997, CVPR 1997.

[27]  Yong Yu,et al.  Sparse-as-possible SVBRDF acquisition , 2016, ACM Trans. Graph..

[28]  S. Marschner,et al.  Measuring and modeling the appearance of finished wood , 2005, SIGGRAPH 2005.

[29]  F. E. Nicodemus,et al.  Geometrical considerations and nomenclature for reflectance , 1977 .

[30]  John M. Snyder,et al.  Manifold bootstrapping for SVBRDF capture , 2010, ACM Trans. Graph..

[31]  M. Koudelka,et al.  Acquisition , Compression , and Synthesis of Bidirectional Texture Functions , 2003 .

[32]  Reinhard Klein,et al.  Advances in geometry and reflectance acquisition (course notes) , 2015, SIGGRAPH Asia Courses.

[33]  Jiyang Yu,et al.  Sparse Sampling for Image-Based SVBRDF Acquisition , 2016, MAM@EGSR.

[34]  Michael Weinmann,et al.  Material Classification Based on Training Data Synthesized Using a BTF Database , 2014, ECCV.

[35]  Christopher Schwartz,et al.  Integrated High-Quality Acquisition of Geometry and Appearance for Cultural Heritage , 2011, VAST.

[36]  Tien-Tsin Wong,et al.  Image-based Rendering with Controllable Illumination , 1997, Rendering Techniques.

[37]  Christopher Schwartz,et al.  Data Driven Surface Reflectance from Sparse and Irregular Samples , 2012, Comput. Graph. Forum.

[38]  Katsushi Ikeuchi,et al.  Appearance Based Object Modeling using Texture Database: Acquisition Compression and Rendering , 2002, Rendering Techniques.