Pose and illumination invariant 2D to 3D facial recognition system

This paper proposes a pose and illumination invariant face recognition method based on a 2D to 3D facial recognition system which uses two dimensional (2D) image as an input and three dimensional (3D) data as a database. To improve the performance of a facial recognition system, we reorganize the framework of a conventional recognition system into more suitable framework for a 2D to 3D facial recognition system. 2D to 3D pose and illumination estimation algorithm is proposed based on a learning algorithm using multilayer perceptron (MLP). The proposed method estimates both pose and illumination factors of an input image in real-time, and compensates for a database in order to overcome the problems of pose and illumination without any occlusion occurred by insufficient information. To evaluate the performance, we performed both the accuracy tests of pose and illumination estimation and the recognition tests of 2D to 3D facial recognition system with a face database containing both two and three dimensional data.

[1]  Kwanghoon Sohn,et al.  Three-dimensional sensor-based face recognition. , 2005, Applied optics.

[2]  P. Jonathon Phillips,et al.  Face recognition vendor test 2002 , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[3]  Vojislav Kecman,et al.  Learning and Soft Computing: Support Vector Machines, Neural Networks, and Fuzzy Logic Models , 2001 .

[4]  Yajie Tian,et al.  Handbook of face recognition , 2003 .

[5]  Vojislav Kecman.  Support Vector Machines , 2001 .

[6]  Hyeonjoon Moon,et al.  The FERET verification testing protocol for face recognition algorithms , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Patrick J. Flynn,et al.  Preliminary Face Recognition Grand Challenge Results , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[8]  Kwanghoon Sohn,et al.  Local Feature Based 3D Face Recognition , 2005, AVBPA.

[9]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[10]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[11]  Kwanghoon Sohn,et al.  Face recognition using facial shape indices with two different three-dimensional sensors , 2007 .

[12]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.