Uncalibrated photometric stereo based on elevation angle recovery from BRDF symmetry of isotropic materials

This paper addresses the problem of uncalibrated photometric stereo with isotropic reflectances. Existing methods face difficulty in solving for the elevation angles of surface normals when the light sources only cover the visible hemisphere. Here, we introduce the notion of “constrained half-vector symmetry” for general isotropic BRDFs and show its capability of elevation angle recovery. This sort of symmetry can be observed in a 1D BRDF slice from a subset of surface normals with the same azimuth angle, and we use it to devise an efficient modeling and solution method to constrain and recover the elevation angles of surface normals accurately. To enable our method to work in an uncalibrated manner, we further solve for light sources in the case of general isotropic BRDFs. By combining this method with the existing ones for azimuth angle estimation, we can get state-of-the-art results for uncalibrated photometric stereo with general isotropic reflectances.

[1]  Kiyoharu Aizawa,et al.  Robust photometric stereo using sparse regression , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Steven M. Seitz,et al.  Example-based photometric stereo: shape reconstruction with general, varying BRDFs , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Katsushi Ikeuchi,et al.  Elevation Angle from Reflectance Monotonicity: Photometric Stereo for General Isotropic Reflectances , 2012, ECCV.

[4]  Takahiro Okabe,et al.  Uncalibrated Photometric Stereo for Unknown Isotropic Reflectances , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[6]  Holger Winnemöller,et al.  Light Waving: Estimating Light Positions From Photographs Alone , 2005, SIGGRAPH '05.

[7]  Katsushi Ikeuchi,et al.  Median Photometric Stereo as Applied to the Segonko Tumulus and Museum Objects , 2009, International Journal of Computer Vision.

[8]  Long Quan,et al.  The Geometry of Reflectance Symmetries , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[10]  David J. Kriegman,et al.  Toward Reconstructing Surfaces With Arbitrary Isotropic Reflectance : A Stratified Photometric Stereo Approach , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Ravi Ramamoorthi,et al.  A theory of differential photometric stereo for unknown isotropic BRDFs , 2011, CVPR 2011.

[12]  Jason Lawrence,et al.  A photometric approach for estimating normals and tangents , 2008, ACM Trans. Graph..

[13]  Ping Tan,et al.  Ring-Light Photometric Stereo , 2010, ECCV.

[14]  S. Marschner,et al.  Inverse Rendering for Computer Graphics , 1998 .

[15]  Szymon Rusinkiewicz,et al.  A New Change of Variables for Efficient BRDF Representation , 1998, Rendering Techniques.

[16]  Yasuyuki Matsushita,et al.  Self-calibrating photometric stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Baining Guo,et al.  Pocket reflectometry , 2011, SIGGRAPH 2011.

[18]  Takahiro Okabe,et al.  Attached shadow coding: Estimating surface normals from shadows under unknown reflectance and lighting conditions , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Zhe Wu,et al.  Calibrating Photometric Stereo by Holistic Reflectance Symmetry Analysis , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[21]  Takahiro Okabe,et al.  Shape Reconstruction Based on Similarity in Radiance Changes under Varying Illumination , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Paolo Favaro,et al.  A closed-form solution to uncalibrated photometric stereo via diffuse maxima , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Yongtian Wang,et al.  Robust Photometric Stereo via Low-Rank Matrix Completion and Recovery , 2010, ACCV.

[24]  Athinodoros S. Georghiades,et al.  Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .