Robust albedo estimation from a facial image with cast shadow

Albedo estimation from a facial image is crucial for various computer vision tasks such as 3D morphable model fitting, shape recovery and illumination-invariant face recognition, but it has not been addressed well. This paper describes how albedo can be estimated from the combined use of image intensity and facial depth information even if the image is under general, unknown light with cast shadow. In order to estimate the albedo map, we formulate the albedo estimation problem as a linear programming using 1-norm under the assumption that the surface of a face has a constant albedo. The proposed method is simple and the experiment results show that the proposed approach gives better albedo estimation than other methods.

[1]  Josef Kittler,et al.  Robust albedo estimation from face image under unknown illumination , 2008, SPIE Defense + Commercial Sensing.

[2]  Ravi Ramamoorthi,et al.  Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  John Edward Warnock,et al.  A hidden surface algorithm for computer generated halftone pictures , 1969 .

[4]  D. Knill,et al.  The perception of cast shadows , 1998, Trends in Cognitive Sciences.

[5]  Shiguang Shan,et al.  Face relighting for face recognition under generic illumination , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[7]  Zicheng Liu,et al.  Face relighting with radiance environment maps , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[8]  Mehrdad Shahshahani,et al.  Distributing Points on the Sphere, I , 2003, Exp. Math..

[9]  Sami Romdhani,et al.  Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions , 2002, ECCV.

[10]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[11]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Lei Zhang,et al.  Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Chong-Ho Choi,et al.  Robust Albedo Estimation From a Facial Image With Cast Shadow Under General Unknown Lighting , 2013, IEEE Transactions on Image Processing.

[14]  Margaret A. Hagen,et al.  The development of sensitivity to cast and attached shadows in pictures as information for the direction of the source of illumination , 1976 .

[15]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Rama Chellappa,et al.  Robust Estimation of Albedo for Illumination-invariant Matching and Shape Recovery , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[17]  Edwin R. Hancock,et al.  Estimating the albedo map of a face from a single image , 2005, IEEE International Conference on Image Processing 2005.

[18]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[19]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Alin Achim,et al.  18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, September 11-14, 2011 , 2011, ICIP.

[21]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[22]  Wen Gao,et al.  Face recognition under generic illumination based on harmonic relighting , 2005, Int. J. Pattern Recognit. Artif. Intell..

[23]  Gang Hua,et al.  Face Re-Lighting from a Single Image under Harsh Lighting Conditions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Yin Zhang,et al.  On polynomiality of the Mehrotra-type predictor—corrector interior-point algorithms , 1995, Math. Program..