Face detection and recognition method based on skin color and depth information

An improved face detection and recognition method based on information of skin color and depth obtained by binocular vision system was proposed in this paper. With this method, the face area was detected firstly by using Adaboost algorithm. Afterwards, the real face was distinguished from fake one by using the skin color information and the depth data. Then, by using PCA algorithm, a specific face can be recognized by comparing the principal components of the current face to those of the known individuals in a facial database built in advance. This method was applied to a service robot equipped with a binocular camera system for real-time face detection and recognition experiment, and satisfactory results were obtained.

[1]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[2]  Michael G. Strintzis,et al.  Three Dimensional Face Recognition , 2008, Encyclopedia of Multimedia.

[3]  Te-Hsiu Sun,et al.  Face recognition using 2D and disparity eigenface , 2007, Expert Syst. Appl..

[4]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[5]  Qiuqi Ruan,et al.  Face stereo matching and disparity calculation in binocular vision system , 2010, 2010 2nd International Conference on Industrial and Information Systems.

[6]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[7]  Michael G. Strintzis,et al.  Use of depth and colour eigenfaces for face recognition , 2003, Pattern Recognit. Lett..

[8]  Hans-Peter Seidel,et al.  Accurate Real-Time Disparity Estimation with Variational Methods , 2009, ISVC.

[9]  Brendan J. Frey,et al.  Mixtures of local linear subspaces for face recognition , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[10]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[11]  Hans-Peter Seidel,et al.  Rapid stereo-vision enhanced face detection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[12]  Stan Z. Li,et al.  Learning to detect multi-view faces in real-time , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[13]  Rainer Lienhart,et al.  Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection , 2003, DAGM-Symposium.

[14]  JIAN-GANG WANG,et al.  Real-time Stereo Face Recognition by Fusing Appearance and Depth Fisherfaces , 2007, J. VLSI Signal Process..

[15]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.