A Microfacet-Based Reflectance Model for Photometric Stereo with Highly Specular Surfaces

A precise, stable and invertible model for surface reflectance is the key to the success of photometric stereo with real world materials. Recent developments in the field have enabled shape recovery techniques for surfaces of various types, but an effective solution to directly estimating the surface normal in the presence of highly specular reflectance remains elusive. In this paper, we derive an analytical isotropic microfacet-based reflectance model, based on which a physically interpretable approximate is tailored for highly specular surfaces. With this approximate, we identify the equivalence between the surface recovery problem and the ellipsoid of revolution fitting problem, where the latter can be described as a system of polynomials. Additionally, we devise a fast, non-iterative and globally optimal solver for this problem. Experimental results on both synthetic and real images validate our model and demonstrate that our solution can stably deliver superior performance in its targeted application domain.

[1]  Katsushi Ikeuchi,et al.  Elevation Angle from Reflectance Monotonicity: Photometric Stereo for General Isotropic Reflectances , 2012, ECCV.

[2]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[3]  Athinodoros S. Georghiades,et al.  Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[5]  E. Saff,et al.  Minimal Discrete Energy on the Sphere , 1994 .

[6]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[7]  Giljoo Nam,et al.  Simultaneous acquisition of microscale reflectance and normals , 2016, ACM Trans. Graph..

[8]  M. Ashikhmin,et al.  Distribution-based BRDFs , 2007 .

[9]  Steve Marschner,et al.  The Ellipsoid Normal Distribution Function , 2015 .

[10]  G. Vickers The projected areas of ellipsoids and cylinders , 1996 .

[11]  Peter Shirley,et al.  An Anisotropic Phong BRDF Model , 2000, J. Graphics, GPU, & Game Tools.

[12]  John M. Snyder,et al.  Manifold bootstrapping for SVBRDF capture , 2010, ACM Trans. Graph..

[13]  Andrew Gardner,et al.  Linear light source reflectometry , 2003, ACM Trans. Graph..

[14]  Yongtian Wang,et al.  Robust Photometric Stereo via Low-Rank Matrix Completion and Recovery , 2010, ACCV.

[15]  Zhe Wu,et al.  Calibrating Photometric Stereo by Holistic Reflectance Symmetry Analysis , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Andrew Jones,et al.  Relighting human locomotion with flowed reflectance fields , 2006, EGSR '06.

[17]  Katsushi Ikeuchi,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Bi-polynomial Modeling of Low-frequency Reflectances , 2022 .

[18]  Alessio Del Bue,et al.  Direct Differential Photometric Stereo Shape Recovery of Diffuse and Specular Surfaces , 2016, Journal of Mathematical Imaging and Vision.

[19]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[20]  T. Trowbridge,et al.  Average irregularity representation of a rough surface for ray reflection , 1975 .

[21]  David J. Kriegman,et al.  Photometric stereo with non-parametric and spatially-varying reflectance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Frédo Durand,et al.  Experimental analysis of BRDF models , 2005, EGSR '05.

[23]  E. Heitz Understanding the Masking-Shadowing Function in Microfacet-Based BRDFs , 2014 .

[24]  Katsushi Ikeuchi,et al.  Consensus photometric stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[26]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[27]  Steven M. Seitz,et al.  Shape and Spatially-Varying BRDFs from Photometric Stereo , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Kiyoharu Aizawa,et al.  Photometric Stereo Using Constrained Bivariate Regression for General Isotropic Surfaces , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  David J. Kriegman,et al.  Toward Reconstructing Surfaces With Arbitrary Isotropic Reflectance : A Stratified Photometric Stereo Approach , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[30]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[31]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[32]  Shree K. Nayar,et al.  Generalization of Lambert's reflectance model , 1994, SIGGRAPH.

[33]  Kiyoharu Aizawa,et al.  Photometric Stereo Using Sparse Bayesian Regression for General Diffuse Surfaces , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Brent Burley Physically-Based Shading at Disney , 2012 .

[35]  Andrew Jones,et al.  Relighting human locomotion with flowed reflectance fields , 2006, EGSR '06.

[36]  Aswin C. Sankaranarayanan,et al.  A Dictionary-Based Approach for Estimating Shape and Spatially-Varying Reflectance , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[37]  Steve Marschner,et al.  Microfacet Models for Refraction through Rough Surfaces , 2007, Rendering Techniques.

[38]  Jiaya Jia,et al.  Efficient photometric stereo on glossy surfaces with wide specular lobes , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Zhe Wu,et al.  A Benchmark Dataset and Evaluation for Non-Lambertian and Uncalibrated Photometric Stereo , 2019, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Viktor Larsson,et al.  Uncovering Symmetries in Polynomial Systems , 2016, ECCV.

[41]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.

[42]  B. Smith,et al.  Geometrical shadowing of a random rough surface , 1967 .

[43]  Ron Goldman,et al.  Curvature formulas for implicit curves and surfaces , 2005, Comput. Aided Geom. Des..

[44]  Derek Nowrouzezahrai,et al.  A Non-Parametric Factor Microfacet Model for Isotropic BRDFs , 2016, ACM Trans. Graph..

[45]  Steve Marschner,et al.  Predicting Appearance from Measured Microgeometry of Metal Surfaces , 2015, ACM Trans. Graph..