Real-time face detection and recognition using hybrid-information extracted from face space and facial features

This paper describes both face detection using the eigenface space and face recognition using neural networks. Real-time face detection from face images was performed in two steps. In the first step, a normalized skin color map based on the Gaussian function was applied to extract a face candidate region. The facial feature information in the candidate region was employed to detect the face region. In this step, face detection was sequentially accomplished using three methods. DFFS, a combination of DFFS and DIFS, and template matching were used. Facial features were extracted according to the Euclidian distance between the determined face region and the predefined eigenfaces from the face region. In the second step, neural network models were trained using 120 images for face recognition. In the experiments, three neural network models corresponding to input variables that included features from face spaces, facial features (geometrical features), and both, were constructed. The image of each person was obtained based on the various directions, poses, and facial expressions. The number of hidden layers was changed from 1 to 3 for several tests of the neural network models. The goal of this study was to reduce lighting effects in order to achieve high-performance of face recognition, because face recognition cannot cope with changes due to lighting.

[1]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Cordelia Schmid,et al.  Face Detection and Tracking in a Video by Propagating Detection Probabilities , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Ioannis Pitas,et al.  Frontal face detection using support vector machines and back-propagation neural networks , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[4]  D. Capson,et al.  Real-time template matching using cooperative windows , 1997, CCECE '97. Canadian Conference on Electrical and Computer Engineering. Engineering Innovation: Voyage of Discovery. Conference Proceedings.

[5]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Patrick M. Lenders,et al.  Knowledge-based eye detection for human face recognition , 2000, KES'2000. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies. Proceedings (Cat. No.00TH8516).

[7]  Gerhard Rigoll,et al.  Content based indexing of images and video using face detection and recognition methods , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[8]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jun Zhang,et al.  Pace recognition: eigenface, elastic matching, and neural nets , 1997, Proc. IEEE.

[10]  Jongmoo Choi,et al.  A real-time face recognition system using multiple mean faces and dual mode Fisherfaces , 2001, ISIE 2001. 2001 IEEE International Symposium on Industrial Electronics Proceedings (Cat. No.01TH8570).

[11]  Stan Z. Li,et al.  FloatBoost learning and statistical face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Witold Pedrycz,et al.  Face recognition: A study in information fusion using fuzzy integral , 2005, Pattern Recognit. Lett..

[13]  B. Menser,et al.  Face detection in color images using principal components analysis , 1999 .

[14]  Chengjun Liu,et al.  A Bayesian Discriminating Features Method for Face Detection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Bo Wang,et al.  Face detection and recognition using neural network and hidden Markov models , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[16]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..