Toward Driver Face Recognition in the Intelligent Traffic Monitoring Systems

This paper models the driver face recognition problem under the intelligent traffic monitoring systems as severe illumination variation face recognition with single sample problem. Firstly, in the point of view of numerical value sign, the current illumination invariant unit is derived from the subtraction of two pixels in the face local region, which may be positive or negative, we propose a generalized illumination robust (GIR) model based on positive and negative illumination invariant units to tackle severe illumination variations. Then, the GIR model can be used to generate several GIR images based on the local edge-region or the local block-region, which results in the edge-region based GIR (EGIR) image or the block-region based GIR (BGIR) image. For single GIR image based classification, the GIR image utilizes the saturation function and the nearest neighbor classifier, which can develop EGIR-face and BGIR-face. For multi GIR images based classification, the GIR images employ the extended sparse representation classification (ESRC) as the classifier that can form the EGIR image based classification (GIRC) and the BGIR image based classification (BGIRC). Further, the GIR model is integrated with the pre-trained deep learning (PDL) model to construct the GIR-PDL model. Finally, the performances of the proposed methods are verified on the Extended Yale B, CMU PIE, AR, self-built Driver and VGGFace2 face databases. The experimental results indicate that the proposed methods are efficient to tackle severe illumination variations.

[1]  Changhui Hu,et al.  Singular value decomposition and local near neighbors for face recognition under varying illumination , 2017, Pattern Recognit..

[2]  Changhui Hu,et al.  A new face recognition method based on image decomposition for single sample per person problem , 2015, Neurocomputing.

[3]  Stefanos Zafeiriou,et al.  ArcFace: Additive Angular Margin Loss for Deep Face Recognition , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Majid Ahmadi,et al.  An efficient illumination invariant face recognition framework via illumination enhancement and DD-DTCWT filtering , 2013, Pattern Recognit..

[5]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  D. Donoho,et al.  Fast Solution of -Norm Minimization Problems When the Solution May Be Sparse , 2008 .

[7]  Jean-Marie Morvan,et al.  Improving Shadow Suppression for Illumination Robust Face Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jing-Wein Wang,et al.  Color face image enhancement using adaptive singular value decomposition in fourier domain for face recognition , 2016, Pattern Recognit..

[9]  Yuan Yan Tang,et al.  Face Recognition Under Varying Illumination Using Gradientfaces , 2009, IEEE Transactions on Image Processing.

[10]  Simon J. Godsill,et al.  Driver and Passenger Identification From Smartphone Data , 2019, IEEE Transactions on Intelligent Transportation Systems.

[11]  Jian-Huang Lai,et al.  Illumination invariant single face image recognition under heterogeneous lighting condition , 2017, Pattern Recognit..

[12]  Satish Kumar Singh,et al.  Local directional gradient pattern: a local descriptor for face recognition , 2022, Multimedia Tools and Applications.

[13]  Xin Wang,et al.  Virtual dictionary based kernel sparse representation for face recognition , 2018, Pattern Recognit..

[14]  Jian-Huang Lai,et al.  Normalization of Face Illumination Based on Large-and Small-Scale Features , 2011, IEEE Transactions on Image Processing.

[15]  Omkar M. Parkhi,et al.  VGGFace2: A Dataset for Recognising Faces across Pose and Age , 2017, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[16]  Shiv Ram Dubey,et al.  Local Bit-Plane Decoded Pattern: A Novel Feature Descriptor for Biomedical Image Retrieval , 2016, IEEE Journal of Biomedical and Health Informatics.

[17]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[18]  Haoyang Yu,et al.  Deep Face Recognition Using Adaptively-Weighted Verification Loss Function , 2017, IFTC.

[19]  Meng Joo Er,et al.  Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Shiv Ram Dubey,et al.  Local Wavelet Pattern: A New Feature Descriptor for Image Retrieval in Medical CT Databases , 2015, IEEE Transactions on Image Processing.

[21]  Yaakov Tsaig,et al.  Fast Solution of $\ell _{1}$ -Norm Minimization Problems When the Solution May Be Sparse , 2008, IEEE Transactions on Information Theory.

[22]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[23]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Sergio M. Savaresi,et al.  Automatic Detection of Driver Impairment Based on Pupillary Light Reflex , 2019, IEEE Transactions on Intelligent Transportation Systems.

[25]  Alan L. Yuille,et al.  Semi-Supervised Sparse Representation Based Classification for Face Recognition With Insufficient Labeled Samples , 2016, IEEE Transactions on Image Processing.

[26]  Yuan Yan Tang,et al.  Multiscale facial structure representation for face recognition under varying illumination , 2009, Pattern Recognit..

[27]  Shiv Ram Dubey,et al.  Multichannel Decoded Local Binary Patterns for Content-Based Image Retrieval , 2016, IEEE Transactions on Image Processing.

[28]  Jun Guo,et al.  Extended SRC: Undersampled Face Recognition via Intraclass Variant Dictionary , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Shahzad Anwar,et al.  Driver Fatigue Detection Systems: A Review , 2019, IEEE Transactions on Intelligent Transportation Systems.

[30]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[31]  Weiyao Lin,et al.  Supervised-learning based face hallucination for enhancing face recognition , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  Dorin Comaniciu,et al.  Total variation models for variable lighting face recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Albert Ali Salah,et al.  Continuous Real-Time Vehicle Driver Authentication Using Convolutional Neural Network Based Face Recognition , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[34]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[35]  Biao Wang,et al.  Illumination Normalization Based on Weber's Law With Application to Face Recognition , 2011, IEEE Signal Processing Letters.

[36]  Satish Kumar Singh,et al.  Centre symmetric quadruple pattern: A novel descriptor for facial image recognition and retrieval , 2017, Pattern Recognit. Lett..

[37]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Yicong Zhou,et al.  Generalized Weber-face for illumination-robust face recognition , 2014, Neurocomputing.

[40]  Satish Kumar Singh,et al.  R-theta local neighborhood pattern for unconstrained facial image recognition and retrieval , 2018, Multimedia Tools and Applications.

[41]  Dao-Qing Dai,et al.  Multiscale Logarithm Difference Edgemaps for Face Recognition Against Varying Lighting Conditions , 2015, IEEE Transactions on Image Processing.

[42]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).