Prominent facial feature and hybrid learning method-based advanced face detector robust to head-up, head-down, and arbitrary rotation cases

Face detection is important for computer vision. Until now, the Viola and Jones algorithm is still the most popular face detector embedded in digital cameras. Although it has good performance in frontal face detection, it may not perform well in detecting rotated, head-up, and head-down faces. In this paper, we propose a more robust face detector based on prominent feature extraction. We find that, in addition to using eyes and mouth, which have been adopted by other algorithms, noses and ears are also important clues for face detection. Particularly, for a profile face, only a single eye can be detected. For head-up or head-down faces, eyes and mouth may not be well detected. However, in these cases, noses and ears can still be detected well and we can apply these features to improve the accuracy of rotated, head-up, and head-down face detection. To well detect these prominent features, in addition to the Viola–Jones detector, we also apply edge and color information and use the refocus algorithm based on the convolutional neural network. Simulations conducted on several popular multi-view face databases show that the proposed face detector can attain higher detection rates and is robust to rotated, head-up, and head-down cases.

[1]  Jian-Jiun Ding,et al.  Robust in-plane and out-of-plane face detection algorithm using frontal face detector and symmetry extension , 2018, Image Vis. Comput..

[2]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  Zhengyou Zhang,et al.  Improving multiview face detection with multi-task deep convolutional neural networks , 2014, IEEE Winter Conference on Applications of Computer Vision.

[5]  Larry S. Davis,et al.  SSH: Single Stage Headless Face Detector , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  A. Saaidi,et al.  A New Robust Face Detection Method Based on Corner Points , 2014 .

[7]  Liu Jianzhuang,et al.  Automatic thresholding of gray-level pictures using two-dimension Otsu method , 1991, China., 1991 International Conference on Circuits and Systems.

[8]  Xiaoqing Ding,et al.  Real-time multi-view face detection and pose estimation based on cost-sensitive AdaBoost , 2005 .

[9]  Jian-Jiun Ding,et al.  Advanced Orientation Robust Face Detection Algorithm Using Prominent Features and Hybrid Learning Techniques , 2018, 2018 IEEE Visual Communications and Image Processing (VCIP).

[10]  Renjie Liao,et al.  Deep Edge-Aware Filters , 2015, ICML.

[11]  Hakan Cevikalp,et al.  Efficient object detection using cascades of nearest convex model classifiers , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Yu Deng,et al.  Face Image Quality Assessment Based on Learning to Rank , 2015, IEEE Signal Processing Letters.

[14]  Xiaoou Tang,et al.  Facial Landmark Detection by Deep Multi-task Learning , 2014, ECCV.

[15]  Charless C. Fowlkes,et al.  Occlusion Coherence: Localizing Occluded Faces with a Hierarchical Deformable Part Model , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Xiaoming Liu,et al.  Large-Pose Face Alignment via CNN-Based Dense 3D Model Fitting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Deepak Ghimire,et al.  A Robust Face Detection Method Based on Skin Color and Edges , 2013, J. Inf. Process. Syst..

[18]  H. D. Cheng,et al.  A simple and effective histogram equalization approach to image enhancement , 2004, Digit. Signal Process..

[19]  Jian-Jiun Ding,et al.  Advanced Ear Detection Algorithm Using Faster R-CNN, Refocus Filters, and the Gradient Map , 2018, 2018 IEEE 23rd International Conference on Digital Signal Processing (DSP).

[20]  Shihong Lao,et al.  Boosting nested cascade detector for multi-view face detection , 2004, ICPR 2004.

[21]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Seokhoon Kang,et al.  Faces detection method based on skin color modeling , 2016, J. Syst. Archit..

[23]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[25]  Gang Hua,et al.  A convolutional neural network cascade for face detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Maja Pantic,et al.  Empirical analysis of cascade deformable models for multi-view face detection , 2013, Image Vis. Comput..

[27]  Juan-li Hu,et al.  A Novel Algorithm for Color Space Conversion Model from CMYK to LAB , 2010, J. Multim..

[28]  Shengcai Liao,et al.  A Fast and Accurate Unconstrained Face Detector , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Ausif Mahmood,et al.  Deep face liveness detection based on nonlinear diffusion using convolution neural network , 2016, Signal, Image and Video Processing.

[30]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[31]  Bin Yang,et al.  Aggregate channel features for multi-view face detection , 2014, IEEE International Joint Conference on Biometrics.

[32]  Li-Jia Li,et al.  Multi-view Face Detection Using Deep Convolutional Neural Networks , 2015, ICMR.