Robust Estimation of Albedo for Illumination-invariant Matching and Shape Recovery

In this paper, we propose a non-stationary stochastic filtering framework for the task of albedo estimation from a single image. There are several approaches in literature for albedo estimation, but few include the errors in estimates of surface normals and light source directions to improve the albedo estimate. The proposed approach effectively utilizes the error statistics of surface normals and illumination direction for robust estimation of albedo. The albedo estimate obtained is further used to generate albedo-free normalized images for recovering the shape of an object. Illustrations and experiments are provided to show the efficacy of the approach and its application to illumination-invariant matching and shape recovery.

[1]  B. V. K. Vijaya Kumar,et al.  "Corefaces" - robust shift invariant PCA based correlation filter for illumination tolerant face recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[2]  Rama Chellappa,et al.  Pose-Encoded Spherical Harmonics for Face Recognition and Synthesis Using a Single Image , 2008, EURASIP J. Adv. Signal Process..

[3]  Rama Chellappa,et al.  Characterization of Human Faces under Illumination Variations Using Rank, Integrability, and Symmetry Constraints , 2004, ECCV.

[4]  Dimitris N. Metaxas,et al.  Incorporating Illumination Constraints in Deformable Models for Shape from Shading and Light Direction Estimation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  A A Sawchuk,et al.  Estimation of images degraded by film-grain noise. , 1978, Applied optics.

[6]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Pradeep K. Khosla,et al.  "Corefaces" - robust shift invariant PCA based correlation filter for illumination tolerant face recognition , 2004, CVPR 2004.

[8]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Edwin R. Hancock,et al.  Recovering Facial Shape Using a Statistical Model of Surface Normal Direction , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Mubarak Shah,et al.  Shape from shading using linear approximation , 1994, Image Vis. Comput..

[11]  Shang-Hong Lai,et al.  Robust Face Image Matching under Illumination Variations , 2004, EURASIP J. Adv. Signal Process..

[12]  David J. Kriegman,et al.  Nine points of light: acquiring subspaces for face recognition under variable lighting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Paul A. Griffin,et al.  Statistical Approach to Shape from Shading: Reconstruction of Three-Dimensional Face Surfaces from Single Two-Dimensional Images , 1996, Neural Computation.

[14]  Rama Chellappa,et al.  Symmetric Shape-from-Shading Using Self-ratio Image , 2001, International Journal of Computer Vision.

[15]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Andrew P. Sage,et al.  Estimation theory with applications to communications and control , 1979 .

[18]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Rama Chellappa,et al.  Face recognition in the presence of multiple illumination sources , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[20]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Rama Chellappa,et al.  Robust Estimation of Albedo for Illumination-invariant Matching and Shape Recovery , 2007, ICCV.

[22]  B. R. Hunt,et al.  Digital Image Restoration , 1977 .

[23]  Arun N. Netravali,et al.  Image Restoration Based on a Subjective Criterion , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[24]  Sami Romdhani,et al.  Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions , 2002, ECCV.

[25]  Lei Zhang,et al.  Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Leonard M. Silverman,et al.  Nonlinear Restoration of Noisy Images , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  R. Basri,et al.  Statistical Symmetric Shape from Shading for 3D Structure Recovery of Faces , 2004, eccv 2004.

[29]  Baback Moghaddam,et al.  A Practical Face Relighting Method for Directional Lighting Normalization , 2005, AMFG.

[30]  Arnold W. M. Smeulders,et al.  The Amsterdam Library of Object Images , 2004, International Journal of Computer Vision.

[31]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[32]  A Hurlbert,et al.  Formal connections between lightness algorithms. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[33]  Bobby R. Hunt,et al.  Sectioned methods for image restoration , 1978 .

[34]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Michael J. Brooks,et al.  Shape and Source from Shading , 1985, IJCAI.