A novel infrared and visible face fusion recognition method based on non-subsampled contourlet transform

Near infrared and visible face fusion recognition is an important direction in the field of unconstrained face recognition research. In this paper, a novel fusion algorithm in (NSCT) domain is proposed for infrared and visible face fusion recognition. Firstly, NSCT is used respectively to process the infrared and visible face images, which exploits the image information at multiple scales, orientations, and frequency bands. Then, to exploit the effective discriminant feature and balance the power of high-low frequency band of NSCT coefficients, the local Gabor binary pattern (LGBP) and Local Binary Pattern (LBP) are applied respectively in different frequency parts to obtain the robust representation of infrared and visible face images. Finally, the score-level fusion is used to fuse the all the features for final classification. The proposed fusion face recognition method is tested on HITSZ Lab2 visible and near infrared face database. Experiment results show that the proposed method extracts the complementary features of near-infrared and visible-light images and improves the robustness of unconstrained face recognition.

[1]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[2]  Meng Joo Er,et al.  A novel efficient local illumination compensation method based on DCT in logarithm domain , 2012, Pattern Recognit. Lett..

[3]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[4]  David Zhang,et al.  Using the idea of the sparse representation to perform coarse-to-fine face recognition , 2013, Inf. Sci..

[5]  Jie Wen,et al.  Near-infrared and visible light image fusion algorithm for face recognition , 2015 .

[6]  Ralph Gross,et al.  An Image Preprocessing Algorithm for Illumination Invariant Face Recognition , 2003, AVBPA.

[7]  Longbiao Wang,et al.  Face recognition with local contourlet combined patterns , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Wen Gao,et al.  Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[9]  Yong Xu,et al.  Face recognition using both visible light image and near-infrared image and a deep network , 2017, CAAI Trans. Intell. Technol..

[10]  Jan Flusser,et al.  Near infrared face recognition by combining Zernike moments and undecimated discrete wavelet transform , 2014, Digit. Signal Process..

[11]  Ramachandra Raghavendra,et al.  Particle swarm optimization based fusion of near infrared and visible images for improved face verification , 2011, Pattern Recognit..

[12]  Shengcai Liao,et al.  Illumination Invariant Face Recognition Using Near-Infrared Images , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Biao Wang,et al.  Face recognition based on nonsubsampled contourlet transform and block-based kernel Fisher linear discriminant , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Anisha Mohammed,et al.  A novel medical image fusion scheme employing sparse representation and dual PCNN in the NSCT domain , 2016, 2016 IEEE Region 10 Conference (TENCON).

[15]  Subhas Hati,et al.  IR and visible face recognition using fusion of kernel based features , 2008, 2008 19th International Conference on Pattern Recognition.

[16]  Yong Wang,et al.  Feature extraction using a fast null space based linear discriminant analysis algorithm , 2012, Inf. Sci..

[17]  Zhenhua Guo,et al.  Fusing Local Patterns of Gabor and Non-subsampled Contourlet Transform for Face Recognition , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[18]  Huiyang Xie,et al.  A New Infrared and Visible Image Fusion Algorithm in NSCT Domain , 2017, ICIC.

[19]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[20]  Ioannis Pavlidis,et al.  Infrared and visible image fusion for face recognition , 2004, SPIE Defense + Commercial Sensing.

[21]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  David Zhang,et al.  Bimodal biometrics based on a representation and recognition approach , 2011 .