Facial Recognition for Drunk People Using Thermal Imaging

Face recognition using thermal imaging has the main advantage of being less affected by lighting conditions compared to images in the visible spectrum. However, there are factors such as the process of human thermoregulation that cause variations in the surface temperature of the face. These variations cause recognition systems to lose effectiveness. In particular, alcohol intake causes changes in the surface temperature of the face. It is of high relevance to identify not only if a person is drunk but also their identity. In this paper, we present a technique for face recognition based on thermal face images of drunk people. For the experiments, the Pontificia Universidad Catolica de Valparaiso-Drunk Thermal Face database (PUCV-DTF) was used. The recognition system was carried out by using local binary patterns (LBPs). The LBP features were obtained from the bioheat model from thermal image representation and a fusion of thermal images and a vascular network extracted from the same image. The feature vector for each image is formed by the concatenation of the LBP histogram of the thermogram with an anisotropic filter and the fused image, respectively. The proposed technique has an average percentage of 99.63% in the Rank-10 cumulative classification; this performance is superior compared to using LBP in thermal images that do not use the bioheat model.

[1]  Xavier Maldague,et al.  Vesselness Features and the Inverse Compositional AAM for Robust Face Recognition Using Thermal IR , 2013, AAAI.

[2]  Javier Ruiz-del-Solar,et al.  A comparative study of thermal face recognition methods in unconstrained environments , 2012, Pattern Recognit..

[3]  Javier Ruiz-del-Solar,et al.  Thermal Face Recognition in Unconstrained Environments Using Histograms of LBP Features , 2013, Local Binary Patterns.

[4]  Xin Chen,et al.  IR and visible light face recognition , 2005, Comput. Vis. Image Underst..

[5]  Vassilis Anastassopoulos,et al.  Drunk person identification using thermal infrared images , 2009, 2009 16th International Conference on Digital Signal Processing.

[6]  Lawrence B. Wolff,et al.  Illumination invariant face recognition using thermal infrared imagery , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Qiang Chen,et al.  The Characteristics Study on LBP Operator in Near Infrared Facial Image , 2011, ISNN.

[9]  Francine J. Prokoski,et al.  Identification of individuals by means of facial thermography , 1992, Proceedings 1992 International Carnahan Conference on Security Technology: Crime Countermeasures.

[10]  Lawrence B. Wolff,et al.  Quantitative measurement of illumination invariance for face recognition using thermal infrared imagery , 2003, SPIE Optics + Photonics.

[11]  Jucheng Yang,et al.  Infrared Face Recognition Based on Blood Perfusion Using Bio-Heat Transfer Model , 2010, 2010 Chinese Conference on Pattern Recognition (CCPR).

[12]  Gil Friedrich,et al.  Seeing People in the Dark: Face Recognition in Infrared Images , 2002, Biologically Motivated Computer Vision.

[13]  Yufeng Zheng,et al.  Face detection and eyeglasses detection for thermal face recognition , 2012, Other Conferences.

[14]  Karamjit Bhatia,et al.  Future of Face Recognition: A Review , 2015 .

[15]  Matti Pietikäinen,et al.  Face Recognition with Local Binary Patterns , 2004, ECCV.

[16]  E. C. Lins,et al.  Thermography applied during exercises with or without infrared light-emitting diode irradiation: individual and comparative analysis. , 2013, Photomedicine and laser surgery.

[17]  T. Jayakumar,et al.  Medical applications of infrared thermography: A review , 2012, Infrared Physics & Technology.

[18]  Lijun Jiang,et al.  Infrared Face Recognition by Using Blood Perfusion Data , 2005, AVBPA.

[19]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..

[20]  Esteban Vera,et al.  Face Recognition and Drunk Classification Using Infrared Face Images , 2018, J. Sensors.

[21]  Javier Ruiz-del-Solar,et al.  An enhanced representation of thermal faces for improving local appearance-based face recognition , 2017, Intell. Autom. Soft Comput..

[22]  Pradeep Buddharaju,et al.  Physiology-Based Face Recognition in the Thermal Infrared Spectrum , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Sim Heng Ong,et al.  Infrared facial recognition using modified blood perfusion , 2007, 2007 6th International Conference on Information, Communications & Signal Processing.

[24]  Clinton Fookes,et al.  Detecting changes in facial temperature induced by a sudden auditory stimulus based on deep learning-assisted face tracking , 2019, Scientific Reports.

[25]  Georgia Koukiou,et al.  Intoxication Identification Using Thermal Imaging , 2017, Human-Robot Interaction - Theory and Application.

[26]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[27]  Xin Chen,et al.  PCA-Based Face Recognition in Infrared Imagery: Baseline and Comparative Studies , 2003, AMFG.