3D Assisted 2D Face Recognition: Methodology

We address the problem of pose and illumination invariance in face recognition and propose to use explicit 3D model and variants of existing algorithms for both pose [Fit01, MSCA04] and illumination normalization [ZS04] prior to applying 2D face recognition algorithm. However, contrary to prior work we will use person specific, rather than general 3D face models. The proposed solution is realistic as for many applications the additional cost of acquiring 3D face images during enrolment of the subjects is acceptable. 3D sensing is not required during normal operation of the face recognition system. The proposed methodology achieves illumination invariance by estimating the illumination sources using the 3D face model. By-product of this process is the recovery of the face skin albedo which can be used as a photometrically normalised face image. Standard face recognition techniques can then be applied to such illumination corrected images.

[1]  Marco Paluszny,et al.  Geometric control of G2-cubic A-splines , 1998, Comput. Aided Geom. Des..

[2]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[3]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[4]  Adrian Hilton,et al.  Video-rate capture of dynamic face shape and appearance , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[5]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[6]  Chandrajit L. Bajaj,et al.  Regular algebraic curve segments (III) - applications in interactive design and data fitting , 2001, Comput. Aided Geom. Des..

[7]  A. Ayoub,et al.  Constructing dense correspondences to analyze 3D facial change , 2004, ICPR 2004.

[8]  Rama Chellappa,et al.  SFS based view synthesis for robust face recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[9]  Larry L. Schumaker,et al.  Solving Geometric Problems using Subdivision Methods and Range Analysis , 2005 .

[10]  Jiri Matas,et al.  Support vector machines for face authentication , 2002, Image and Vision Computing.

[11]  Chandrajit L. Bajaj,et al.  A-splines: local interpolation and approximation using Gk-continuous piecewise real algebraic curves , 1999, Comput. Aided Geom. Des..

[12]  Jorge Estrada Sarlabous,et al.  Geometric Design by Means of a G 2 Continuous A-Spline , 2001 .

[13]  Lijun Yin,et al.  3D face recognition based on high-resolution 3D face modeling from frontal and profile views , 2003, WBMA '03.

[14]  Stanley Osher,et al.  Level Set Methods , 2003 .

[15]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  David J. Kriegman,et al.  What is the set of images of an object under all possible lighting conditions? , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  D. M. Morera,et al.  FITTING A CONIC A-SPLINE TO CONTOUR IMAGE , 2002 .

[18]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[19]  Andrew W. Fitzgibbon,et al.  Robust Registration of 2D and 3D Point Sets , 2003, BMVC.

[20]  Bimal Kumar Ray,et al.  A non-parametric sequential method for polygonal approximation of digital curves , 1994, Pattern Recognit. Lett..

[21]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Marco Paluszny,et al.  G 2 continuous cubic algebraic splines and their efficient display , 1994 .

[23]  Josef Kittler,et al.  3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling and Recognition Approachest , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.