Face occlusion detection using skin color ratio and LBP features for intelligent video surveillance systems

A face occlusion detection scheme which is based on both skin color ratio (SCR) and Local Binary Pattern (LBP) feature, is proposed. The proposed method mainly consists of four steps: foreground extraction, head detection, feature extraction, and occlusion detection. First, foreground is extracted by codebook background subtraction algorithm. Then, the head region is located using HOG head detector. After that, the skin-color ratio and LBP feature are extracted. Finally, SVM is trained based on LBP feature. The recognition result of SVM and the result of skin-color ratio feature are merged by weighted voting strategy, and then occluded faces are classified as three categories: concealed, partially concealed, and visible. Experimental results show that the proposed detection system can achieve desirable results in intelligent video surveillance systems.

[1]  Sang Min Yoon,et al.  Detection of Partially Occluded Face Using Support Vector Machines , 2002, MVA.

[2]  R. S. D. Wahida Banu,et al.  Detection of Occluded Face Image using Mean Based Weight Matrix and Support Vector Machine , 2012 .

[3]  Daw-Tung Lin,et al.  Face Occlusion Detection for Automated Teller Machine Surveillance , 2006, PSIVT.

[4]  Matti Pietikäinen,et al.  Unsupervised texture segmentation using feature distributions , 1997, Pattern Recognit..

[5]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Maria Pietruszka,et al.  Fast GPU and CPU computing for head position estimation , 2015, 2015 Federated Conference on Computer Science and Information Systems (FedCSIS).

[7]  Theekapun Charoenpong,et al.  A new method for occluded face detection from single viewpoint of head , 2014, 2014 11th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON).

[8]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Raimondo Schettini,et al.  Scoring recognizability of faces for security applications , 2014, Electronic Imaging.

[10]  Ziqi Zhang,et al.  A Comparative Evaluation of Term Recognition Algorithms , 2008, LREC.

[11]  Ho Gi Jung,et al.  Face occlusion detection by using B-spline active contour and skin color information , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[12]  Konstantinos N. Plataniotis,et al.  Contribution of Skin Color Cue in Face Detection Applications , 2014 .

[13]  Shinpei Kato,et al.  GPU implementations of object detection using HOG features and deformable models , 2013, 2013 IEEE 1st International Conference on Cyber-Physical Systems, Networks, and Applications (CPSNA).

[14]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[15]  Hatice Gunes,et al.  Head detection for video surveillance based on categorical hair and skin colour models , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[16]  Thomas B. Moeslund,et al.  Complete face logs for video sequences using face quality measures , 2009 .

[17]  Hakil Kim,et al.  Real-Time Human Action Recognition Using CNN Over Temporal Images for Static Video Surveillance Cameras , 2015, PCM.

[18]  Sang Min Yoon,et al.  A New Video Surveillance System Employing Occluded Face Detection , 2005, IEA/AIE.

[19]  Frans Coenen,et al.  Face occlusion detection based on multi-task convolution neural network , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[20]  Jae Kyu Suhr,et al.  Face recognizability evaluation for ATM applications with exceptional occlusion handling , 2011, CVPR 2011 WORKSHOPS.

[21]  Jie Yang,et al.  A novel efficient method for abnormal face detection in ATM , 2014, 2014 International Conference on Audio, Language and Image Processing.

[22]  Jean-Luc Dugelay,et al.  Efficient scarf detection prior to face recognition , 2010, 2010 18th European Signal Processing Conference.

[23]  Ho Gi Jung,et al.  Recognizability assessment of facial images for automated teller machine applications , 2012, Pattern Recognit..