Efficient real-time face detection for high resolution surveillance applications

This paper presents an efficient face detection method suitable for real-time surveillance applications. Improved efficiency is achieved by constraining the search window of an AdaBoost face detector to pre-selected regions. Firstly, the proposed method takes a sparse grid of sample pixels from the image to reduce whole image scan time. A fusion of foreground segmentation and skin colour segmentation is then used to select candidate face regions. Finally, a classifier-based face detector is applied only to selected regions to verify the presence of a face (the Viola-Jones detector is used in this paper). The proposed system is evaluated using 640×480 pixels test images and compared with other relevant methods. Experimental results show that the proposed method reduces the detection time to 42 ms, where the Viola-Jones detector alone requires 565 ms (on a desktop processor). This improvement makes the face detector suitable for real-time applications. Furthermore, the proposed method requires 50% of the computation time of the best competing method, while reducing the false positive rate by 3.2% and maintaining the same hit rate.

[1]  Alex Pentland,et al.  LAFTER: lips and face real time tracker , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Chang-Tsun Li,et al.  Skin Colour-Based Face Detection in Colour Images , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[3]  P. Jonathon Phillips,et al.  Face recognition vendor test 2002 , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[4]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Lijing Zhang,et al.  A fast method of face detection in video images , 2010, 2010 2nd International Conference on Advanced Computer Control.

[6]  Daniel Snow,et al.  Pedestrian detection using boosted features over many frames , 2008, 2008 19th International Conference on Pattern Recognition.

[8]  Tiancang Du,et al.  Improved Adaboost Face Detection , 2010, 2010 International Conference on Measuring Technology and Mechatronics Automation.

[9]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Gang Li,et al.  The Study of Face Detection Algorithm Based on Improved AdaBoost with Skin Color Model , 2010, 2010 Symposium on Photonics and Optoelectronics.

[11]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Yan Hou,et al.  Face Detection Based on AdaBoost and Skin Color , 2009, 2009 Second International Symposium on Information Science and Engineering.

[13]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[14]  Yan-Wen Wu,et al.  An Improvement of Face Detection Using AdaBoost with Color Information , 2008, 2008 ISECS International Colloquium on Computing, Communication, Control, and Management.

[15]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[16]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  Jongmoo Choi,et al.  Non-Cooperative Persons Identification at a Distance with 3D Face Modeling , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[18]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  Henry Schneiderman,et al.  Feature-centric evaluation for efficient cascaded object detection , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[20]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Robert Sedgewick,et al.  Algorithms in C , 1990 .

[22]  Zhengyou Zhang,et al.  A Survey of Recent Advances in Face Detection , 2010 .

[23]  S. Sridharan,et al.  Semi-supervised intelligent surveillance system for secure environments , 2010, 2010 IEEE International Symposium on Industrial Electronics.

[24]  Bernd Menser,et al.  Segmentation and tracking of facial regions in color image sequences , 2000, Visual Communications and Image Processing.

[25]  Jong-Hwan Kim,et al.  Fast and Robust Face Detection Using Evolutionary Pruning , 2008, IEEE Transactions on Evolutionary Computation.

[26]  Minh-Tri Pham,et al.  Detection Caching for Faster Object Detection , 2005 .

[27]  Liying Lang,et al.  Study on Face Detection Algorithm Based on Skin Color Segmentation and AdaBoost Algorithm , 2009, 2009 Second Pacific-Asia Conference on Web Mining and Web-based Application.

[28]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[29]  Wen Gao,et al.  Locally Assembled Binary (LAB) feature with feature-centric cascade for fast and accurate face detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.