An accurate and real-time multi-view face detector using ORFs and doubly domain-partitioning classifier

We propose a novel multi-view face detector that operates accurately and fast in challenging environments. It consists of four consecutive functional components: background rejector, pose classifier, pose-specific face detectors, and face validator. The background rejector removes non-face patches quickly, the pose classifier estimates poses of the surviving patches, one or more selected pose-specific face detectors according to their estimated pose labels determine that a given patch is a face by using winner take all (WTA) strategy, and the face validator checks whether the face-like patch is really a face. For achieving strong discrimination power with low computing overhead, we devise several types of order relation features (ORF) that encode the order relation among feature elements as a unique code. The devised ORFs are placed in functional components appropriately to ensure fast operation of the multi-view face detector. For accurate classification, we propose a doubly domain-partitioning (DDP) classifier that consists of a coarse domain-partitioning weak classifier followed by a fine bin-partitioning weighted linear discriminant analysis (wLDA) classifier. For fast classification, we devise a feature sharing method that shares identical features between the background rejector and the pose classifier, and among all classes in the pose classifier. We evaluated the proposed multi-view face detector using the FDDB, AFW, and PASCAL face datasets. The experimental results show that the proposed multi-view face detector outperforms other state-of-the-art methods in terms of detection accuracy and execution time.

[1]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[2]  Daijin Kim,et al.  Robust face detection using local gradient patterns and evidence accumulation , 2012, Pattern Recognit..

[3]  Erik Learned-Miller,et al.  FDDB: A benchmark for face detection in unconstrained settings , 2010 .

[4]  Bin Yang,et al.  Convolutional Channel Features , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Jian Sun,et al.  Face Alignment at 3000 FPS via Regressing Local Binary Features , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Junjie Yan,et al.  Face detection by structural models , 2014, Image Vis. Comput..

[7]  Bin Yang,et al.  Aggregate channel features for multi-view face detection , 2014, IEEE International Joint Conference on Biometrics.

[8]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[9]  Inho Choi,et al.  Local Transform Features and Hybridization for Accurate Face and Human Detection , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Vincent Lepetit,et al.  Fast Keypoint Recognition Using Random Ferns , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Andreas Ernst,et al.  Face detection with the modified census transform , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[12]  Tao Wang,et al.  Face detection using SURF cascade , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[13]  Shengcai Liao,et al.  A Fast and Accurate Unconstrained Face Detector , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[15]  Horst Bischof,et al.  Annotated Facial Landmarks in the Wild: A large-scale, real-world database for facial landmark localization , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[16]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Shuo Yang,et al.  From Facial Parts Responses to Face Detection: A Deep Learning Approach , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  François Fleuret,et al.  Exact Acceleration of Linear Object Detectors , 2012, ECCV.

[19]  Jian Sun,et al.  Joint Cascade Face Detection and Alignment , 2014, ECCV.

[20]  Luc Van Gool,et al.  Face Detection without Bells and Whistles , 2014, ECCV.

[21]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[22]  Shihong Lao,et al.  Boosting nested cascade detector for multi-view face detection , 2004, ICPR 2004.

[23]  Junjie Yan,et al.  Convolutional Channel Features For Pedestrian, Face and Edge Detection , 2015, ArXiv.

[24]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[25]  Ying Wu,et al.  Detecting and Aligning Faces by Image Retrieval , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Paul A. Viola,et al.  Fast Multi-view Face Detection , 2003 .

[27]  Li-Jia Li,et al.  Multi-view Face Detection Using Deep Convolutional Neural Networks , 2015, ICMR.

[28]  Rama Chellappa,et al.  A deep pyramid Deformable Part Model for face detection , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[29]  Gang Hua,et al.  A convolutional neural network cascade for face detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Jiri Matas,et al.  WaldBoost - learning for time constrained sequential detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).