3D face detection based on salient features extraction and skin colour detection using data mining

ABSTRACT Face detection has an essential role in many applications. In this paper, we propose an efficient and robust method for face detection on a 3D point cloud represented by a weighted graph. This method classifies graph vertices as skin and non-skin regions based on a data mining predictive model. Then, the saliency degree of vertices is computed to identify the possible candidate face features. Finally, the matching between non-skin regions representing eyes, mouth and eyebrows and salient regions is done by detecting collisions between polytopes, representing these two regions. This method extracts faces from situations where pose variation and change of expressions can be found. The robustness is showed through different experimental results. Moreover, we study the stability of our method according to noise. Furthermore, we show that our method deals with 2D images.

[1]  Raimondo Schettini,et al.  3D face detection using curvature analysis , 2006, Pattern Recognit..

[2]  Abderrahim Elmoataz,et al.  Mean curvature flow on graphs for image and manifold restoration and enhancement , 2014, Signal Process..

[3]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[4]  Mohammed Bennamoun,et al.  An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Esmaeil Kheirkhah,et al.  A Hybrid Face Detection Approach in Color Images with Complex Background , 2015 .

[6]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[7]  John E. Beasley.  Advances in Linear and Integer Programming , 1996 .

[8]  Silvio Savarese,et al.  Learning a dense multi-view representation for detection, viewpoint classification and synthesis of object categories , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Abderrahim Elmoataz,et al.  Nonlocal processing of 3D colored point clouds , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[10]  Sinisa Todorovic,et al.  From contours to 3D object detection and pose estimation , 2011, 2011 International Conference on Computer Vision.

[11]  Ma Jie,et al.  An Innovative Face Detection based on Skin Color Segmentation , 2011 .

[12]  Abdel Rahman Sayed,et al.  Efficient Image Classification using Data Mining , 2011, Int. J. Comb. Optim. Probl. Informatics.

[13]  Hui Zeng,et al.  3D facial point cloud preprocessing based on skin color detection using SVM , 2014, 2014 10th International Conference on Natural Computation (ICNC).

[14]  Ayoub Al-Hamadi,et al.  A Novel Method for 3D Face Detection and Normalization , 2007, J. Multim..

[15]  Shwu-Huey Yen,et al.  Face Detection Based on Skin Color Segmentation and Neural Network , 2005, 2005 International Conference on Neural Networks and Brain.

[16]  Ayoub Al-Hamadi,et al.  A Stereo and Color-based Method for Face Pose Estimation and Facial Feature Extraction , 2006, 18th International Conference on Pattern Recognition (ICPR'06).