Calibrating Photometric Stereo by Holistic Reflectance Symmetry Analysis

Under unknown directional lighting, the uncalibrated Lambertian photometric stereo algorithm recovers the shape of a smooth surface up to the generalized bas-relief (GBR) ambiguity. We resolve this ambiguity from the half vector symmetry, which is observed in many isotropic materials. Under this symmetry, a 2D BRDF slice with low-rank structure can be obtained from an image, if the surface normals and light directions are correctly recovered. In general, this structure is destroyed by the GBR ambiguity. As a result, we can resolve the ambiguity by restoring this structure. We develop a simple algorithm of auto-calibration from separable homogeneous specular reflection of real images. Compared with previous methods, this method takes a holistic approach to exploiting reflectance symmetry and produces superior results.

[1]  Katsushi Ikeuchi,et al.  Separating reflection components of textured surfaces using a single image , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Hideki Hayakawa.  Photometric stereo under a light source with arbitrary motion , 1994 .

[3]  Athinodoros S. Georghiades,et al.  Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Long Quan,et al.  The Geometry of Reflectance Symmetries , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Szymon Rusinkiewicz,et al.  Efficiently combining positions and normals for precise 3D geometry , 2005, ACM Trans. Graph..

[6]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[7]  Ondrej Drbohlav,et al.  Specularities Reduce Ambiguity of Uncalibrated Photometric Stereo , 2002, ECCV.

[8]  Takayuki Okatani,et al.  Optimal integration of photometric and geometric surface measurements using inaccurate reflectance/illumination knowledge , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  David J. Kriegman,et al.  Reflections on the generalized bas-relief ambiguity , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Mike J. Chantler,et al.  Can two specular pixels calibrate photometric stereo? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  James Arvo,et al.  Barycentric parameterizations for isotropic BRDFs , 2005, IEEE Transactions on Visualization and Computer Graphics.

[12]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[13]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[14]  David J. Kriegman,et al.  Photometric stereo with non-parametric and spatially-varying reflectance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Todd E. Zickler,et al.  A projective framework for radiometric image analysis , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Paolo Favaro,et al.  A closed-form solution to uncalibrated photometric stereo via diffuse maxima , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Ping Tan,et al.  Ring-Light Photometric Stereo , 2010, ECCV.

[18]  Yi Ma,et al.  TILT: Transform Invariant Low-Rank Textures , 2010, ACCV 2010.

[19]  Daniel Snow,et al.  Shape and albedo from multiple images using integrability , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  David J. Kriegman,et al.  Resolving the Generalized Bas-Relief Ambiguity by Entropy Minimization , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Katsushi Ikeuchi,et al.  Temporal-color space analysis of reflection , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Todd E. Zickler,et al.  Passive Reflectometry , 2008, ECCV.

[23]  David J. Kriegman,et al.  Isotropy, Reciprocity and the Generalized Bas-Relief Ambiguity , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Matthew Brand,et al.  Incremental Singular Value Decomposition of Uncertain Data with Missing Values , 2002, ECCV.

[25]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[26]  Katsushi Ikeuchi,et al.  A biquadratic reflectance model for radiometric image analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Szymon Rusinkiewicz,et al.  A New Change of Variables for Efficient BRDF Representation , 1998, Rendering Techniques.