Recovery of Surface Normals and Reflectance from Different Lighting Conditions

This paper presents a method for finding the surface normals and reflectance of an object from a set of images obtained under different lighting conditions. This set of images, assuming a Lambertian object, can be approximated by a three dimensional linear subspace, under an orthographic camera model and without shadows and specularities. However, a higher dimensional subspace is needed when images present pixels in shadow, specularities or ambient illumination. This paper proposes on the one hand to consider pixels in shadow and specularities as missing data; and on the other hand a rank-four formulation to recover the ambient illumination. An adaptation of the Alternationtechnique is introduced to compute the sought surface normals and light-source matrices. Experimental results show the good performance of the proposed Alternation-based strategy.

[1]  R. Hartley,et al.  PowerFactorization : 3D reconstruction with missing or uncertain data , 2003 .

[2]  Amnon Shashua,et al.  On Photometric Issues in 3D Visual Recognition from a Single 2D Image , 2004, International Journal of Computer Vision.

[3]  P. Belhumeur,et al.  Learning Object Representations from LightingVariationsR , 1996 .

[4]  Hideki Hayakawa Photometric stereo under a light source with arbitrary motion , 1994 .

[5]  Li Zhang,et al.  Shape and motion under varying illumination: unifying structure from motion, photometric stereo, and multiview stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Alan L. Yuille,et al.  Learning Object Representation form Lighting Variations , 1996, Object Representation in Computer Vision.

[7]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Ronen Basri,et al.  Photometric stereo with general, unknown lighting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Daniel Snow,et al.  Determining Generative Models of Objects Under Varying Illumination: Shape and Albedo from Multiple Images Using SVD and Integrability , 1999, International Journal of Computer Vision.

[10]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.