Practical BRDF reconstruction using reliable geometric regions from multi-view stereo

In this paper, we present a practical method for reconstructing the bidirectional reflectance distribution function (BRDF) from multiple images of a real object composed of a homogeneous material. The key idea is that the BRDF can be sampled after geometry estimation using multi-view stereo (MVS) techniques. Our contribution is selection of reliable samples of lighting, surface normal, and viewing directions for robustness against estimation errors of MVS. Our method is quantitatively evaluated using synthesized images and its effectiveness is shown via real-world experiments.

[1]  S. Ullman.  The interpretation of structure from motion , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  Pascal Barla,et al.  Light warping for enhanced surface depiction , 2009, ACM Trans. Graph..

[3]  Pieter Peers,et al.  Recovering shape and spatially-varying surface reflectance under unknown illumination , 2016, ACM Trans. Graph..

[4]  Steven M. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, International Journal of Computer Vision.

[5]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[6]  Manmohan Krishna Chandraker,et al.  What Camera Motion Reveals about Shape with Unknown BRDF , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Reinhard Klein.  Erfassung und Präsentation digitaler Replica von Artefakten des kulturellen Erbes Acquisition and Presentation of Virtual Surrogates for Cultural Heritage Artefacts , 2012 .

[8]  Andrew Blake,et al.  The information available to a moving observer from specularities , 1989, Image Vis. Comput..

[9]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[10]  Ko Nishino,et al.  Shape and Reflectance Estimation in the Wild , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Masatoshi Ishikawa,et al.  Rapid SVBRDF Measurement by Algebraic Solution Based on Adaptive Illumination , 2014, 2014 2nd International Conference on 3D Vision.

[13]  Yizhou Wang,et al.  What Object Motion Reveals about Shape with Unknown BRDF and Lighting , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Wojciech Matusik,et al.  Efficient Isotropic BRDF Measurement , 2003, Rendering Techniques.

[15]  Jannik Boll Nielsen,et al.  On optimal, minimal BRDF sampling for reflectance acquisition , 2015, ACM Trans. Graph..

[16]  Zhengqin Li,et al.  Robust Energy Minimization for BRDF-Invariant Shape from Light Fields , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Katsushi Ikeuchi,et al.  Consensus photometric stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  W Erb.  Computer-controlled gonioreflectometer for the measurement of spectral reflection characteristics. , 1980, Applied optics.

[19]  Roberto Cipolla,et al.  Multi-view stereo via volumetric graph-cuts , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Takahiro Okabe,et al.  From Intensity Profile to Surface Normal: Photometric Stereo for Unknown Light Sources and Isotropic Reflectances , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[22]  Szymon Rusinkiewicz,et al.  A New Change of Variables for Efficient BRDF Representation , 1998, Rendering Techniques.

[23]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[24]  Adrien Treuille,et al.  Example-Based Stereo with General BRDFs , 2004, ECCV.