Near infrared and visible face recognition based on decision fusion of LBP and DCT features

Visible face recognition systems, being vulnerable to illumination, expression, and pose, can not achieve robust performance in unconstrained situations. Meanwhile, near infrared face images, being light- independent, can avoid or limit the drawbacks of face recognition in visible light, but its main challenges are low resolution and signal noise ratio (SNR). Therefore, near infrared and visible fusion face recognition has become an important direction in the field of unconstrained face recognition research. In order to extract the discriminative complementary features between near infrared and visible images, in this paper, we proposed a novel near infrared and visible face fusion recognition algorithm based on DCT and LBP features. Firstly, the effective features in near-infrared face image are extracted by the low frequency part of DCT coefficients and the partition histograms of LBP operator. Secondly, the LBP features of visible-light face image are extracted to compensate for the lacking detail features of the near-infrared face image. Then, the LBP features of visible-light face image, the DCT and LBP features of near-infrared face image are sent to each classifier for labeling. Finally, decision level fusion strategy is used to obtain the final recognition result. The visible and near infrared face recognition is tested on HITSZ Lab2 visible and near infrared face database. The experiment results show that the proposed method extracts the complementary features of near-infrared and visible face images and improves the robustness of unconstrained face recognition. Especially for the circumstance of small training samples, the recognition rate of proposed method can reach 96.13%, which has improved significantly than 92.75 % of the method based on statistical feature fusion.

[1]  Ioannis Pavlidis,et al.  Infrared and visible image fusion for face recognition , 2004, SPIE Defense + Commercial Sensing.

[2]  Jie Wen,et al.  Near-infrared and visible light image fusion algorithm for face recognition , 2015 .

[3]  David Zhang,et al.  Bimodal biometrics based on a representation and recognition approach , 2011 .

[4]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Ralph Gross,et al.  An Image Preprocessing Algorithm for Illumination Invariant Face Recognition , 2003, AVBPA.

[6]  Yong Xu,et al.  Face recognition using both visible light image and near-infrared image and a deep network , 2017, CAAI Trans. Intell. Technol..

[7]  Shengcai Liao,et al.  Illumination Invariant Face Recognition Using Near-Infrared Images , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Ramachandra Raghavendra,et al.  Particle swarm optimization based fusion of near infrared and visible images for improved face verification , 2011, Pattern Recognit..

[9]  Subhas Hati,et al.  IR and visible face recognition using fusion of kernel based features , 2008, 2008 19th International Conference on Pattern Recognition.

[10]  Yong Wang,et al.  Feature extraction using a fast null space based linear discriminant analysis algorithm , 2012, Inf. Sci..

[11]  Nithin V. George,et al.  An improved face recognition scheme using transform domain features , 2014, 2014 International Conference on Signal Processing and Integrated Networks (SPIN).

[12]  Meng Joo Er,et al.  A novel efficient local illumination compensation method based on DCT in logarithm domain , 2012, Pattern Recognit. Lett..

[13]  David Zhang,et al.  Using the idea of the sparse representation to perform coarse-to-fine face recognition , 2013, Inf. Sci..

[14]  Zhihua Xie.  Single Sample Face Recognition Based on DCT and Local Gabor Binary Pattern Histogram , 2013, ICIC.