A novel technique for automated concealed face detection in surveillance videos

Face detection perceives great importance in surveillance paradigm and security paradigm areas. Face recognition is the technique to identify a person identity after face detection. Extensive research has been done on these topics. Another important research problem is to detect concealed faces, especially in high-security places like airports or crowded places like concerts and shopping centres, for they may prevail security threat. Also, in order to help effectively in preventing the spread of Coronavirus, people should wear masks during the pandemic especially in the entrance to hospitals and medical facilities. Surveillance systems in medical facilities should issue warnings against unmasked people. This paper presents a novel technique for concealed face detection based on complexion detection to challenge a concealed face assumption. The proposed algorithm first determine of the existence of a human being in the surveillance scene. Head and shoulder contour will be detected. The face will be clustered to cluster patches. Then determination of presence or absent of human skin will be determined. We proposed a hybrid approach that combines normalized RGB (rgb) and the YCbCr space color. This technique is tested on two datasets; the first one contains 650 images of skin patches. The second dataset contains 800 face images. The algorithm achieves an average detection rate of 97.51% for concealed faces. Also, it achieved a run time comparable with existing state-of-the-art concealed face detection systems that run in real time.

[1]  Aamir Shahzad,et al.  Boosting the Face Recognition Performance of Ensemble Based LDA for Pose, Non-uniform Illuminations, and Low-Resolution Images , 2019, KSII Trans. Internet Inf. Syst..

[2]  Mao Ye,et al.  Fast crowd density estimation with convolutional neural networks , 2015, Eng. Appl. Artif. Intell..

[3]  Seho Bae,et al.  A Novel GAN-Based Network for Unmasking of Masked Face , 2020, IEEE Access.

[4]  Shahid Mumtaz,et al.  Deep Unified Model For Face Recognition Based on Convolution Neural Network and Edge Computing , 2019, IEEE Access.

[6]  Wen Gao,et al.  Locally Linear Regression for Pose-Invariant Face Recognition , 2007, IEEE Transactions on Image Processing.

[7]  Jun Peng,et al.  Image retrieval based on YCbCr color histogram , 2013, 2013 IEEE 12th International Conference on Cognitive Informatics and Cognitive Computing.

[8]  Sébastien Chabrier,et al.  Chromatic Indices in the Normalized rgb Color Space , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[9]  Madini O. Alassafi,et al.  Real-Time Surveillance Through Face Recognition Using HOG and Feedforward Neural Networks , 2019, IEEE Access.

[10]  K. Karibasappa,et al.  Survey on skin based face detection on different illumination, poses and occlusion , 2014, 2014 International Conference on Contemporary Computing and Informatics (IC3I).

[11]  Hamid Hassanpour,et al.  An Overview of Face Detection Methods in Angular Positions , 2019, 2019 5th Conference on Knowledge Based Engineering and Innovation (KBEI).

[12]  Bowen Zhang,et al.  Weakly Supervised PatchNets: Describing and Aggregating Local Patches for Scene Recognition , 2016, IEEE Transactions on Image Processing.

[13]  Geevarghese Titus,et al.  Face detection and facial feature extraction based on a fusion of knowledge based method and morphological image processing , 2014, 2014 Annual International Conference on Emerging Research Areas: Magnetics, Machines and Drives (AICERA/iCMMD).

[14]  Cheng Guo,et al.  Design and Implementation of a Face Recognition System Based on Edge Computing , 2019, 2019 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS).

[15]  Chokri Ben Amar,et al.  Regularized Shearlet Network for face recognition using single sample per person , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Nam Ik Cho,et al.  Convolutional neural networks and training strategies for skin detection , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[18]  Chengmei Ruan,et al.  Skin detection using color processing mechanism inspired by the visual system , 2012 .

[19]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[20]  Aishwarya Radhakrishnan Nair,et al.  Masked Face Detection using the Viola Jones Algorithm: A Progressive Approach for less Time Consumption , 2018, Int. J. Recent Contributions Eng. Sci. IT.

[21]  Wai Lok Woo,et al.  Physics-Based Image Segmentation Using First Order Statistical Properties and Genetic Algorithm for Inductive Thermography Imaging , 2017, IEEE Transactions on Image Processing.

[22]  Ru Wang,et al.  Face Detection Based on Template Matching and Neural Network , 2019, 2019 International Conference on Communications, Information System and Computer Engineering (CISCE).

[23]  Jiann-Der Lee,et al.  Panoramic Face Recognition , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Xu Liu,et al.  Uniform color space for color storage , 2007, 2007 Asia Optical Fiber Communication and Optoelectronics Conference.

[25]  Ioannis Pitas,et al.  Robust face recognition via low-rank sparse representation-based classification , 2015, International Journal of Automation and Computing.

[26]  Eduardo Romera,et al.  ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation , 2018, IEEE Transactions on Intelligent Transportation Systems.

[27]  Jong Beom Ra,et al.  Pseudo-color image fusion based on intensity-hue-saturation color space , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[28]  Yu Wu,et al.  Progressive Learning for Person Re-Identification With One Example , 2019, IEEE Transactions on Image Processing.

[29]  Loris Nanni,et al.  Skin detection for reducing false positive in Face Detection , 2017 .

[30]  Yueting Zhuang,et al.  DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection , 2015, IEEE Transactions on Image Processing.

[31]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Tao Song,et al.  Face Recognition based on scale invariant feature transform and Spatial Pyramid Representation , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[33]  Amir Akramin Shafie,et al.  Robust face recognition against expressions and partial occlusions , 2016, International Journal of Automation and Computing.

[34]  Chokri Ben Amar,et al.  Face recognition based on Beta 2D Elastic Bunch Graph Matching , 2013, 13th International Conference on Hybrid Intelligent Systems (HIS 2013).

[35]  Babak Majidi,et al.  Partially Covered Face Detection in Presence of Headscarf for Surveillance Applications , 2019, 2019 4th International Conference on Pattern Recognition and Image Analysis (IPRIA).

[36]  Zahid Mahmood,et al.  A Robust Face Recognition Method for Occluded and Low-Resolution Images , 2019, 2019 International Conference on Applied and Engineering Mathematics (ICAEM).

[37]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[38]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[39]  Charless C. Fowlkes,et al.  Occlusion Coherence: Localizing Occluded Faces with a Hierarchical Deformable Part Model , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Jian Yang,et al.  A Coastline Detection Method in Polarimetric SAR Images Mixing the Region-Based and Edge-Based Active Contour Models , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Minmin Yang,et al.  A cascade framework for masked face detection , 2017, 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM).

[42]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[43]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[44]  Shengcai Liao,et al.  A Fast and Accurate Unconstrained Face Detector , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  C. Molder,et al.  Appearance-based facial detection for recognition , 2012, 2012 9th International Conference on Communications (COMM).

[46]  Alan C. Bovik,et al.  Predicting the Quality of Images Compressed After Distortion in Two Steps , 2018, IEEE Transactions on Image Processing.

[47]  Shiming Ge,et al.  Detecting Masked Faces in the Wild with LLE-CNNs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Ali Yahyaouy,et al.  Texture Classification of skin lesion using convolutional neural network , 2019, 2019 International Conference on Wireless Technologies, Embedded and Intelligent Systems (WITS).

[49]  Rama Chellappa,et al.  Robust Face Recognition From Multi-View Videos , 2014, IEEE Transactions on Image Processing.