Random sparse representation for thermal to visible face recognition

Heterogeneous face recognition (HFR) has a prominent importance in sophisticated face recognition systems. Thermal to visible scenario, where the gallery and the probe images are respectively captured in visible and long wavelength infrared (LWIR) band, is one of the most challenging and interesting HFR scenarios. Since the formation of thermal images does not require an external illumination source, the deployment of thermal probe images is practical even in totally darkness conditions such as night security surveillance systems. In this paper, we propose an ensemble classifier which uses the random subspace idea for defining different representations of each image in distinct base learners, and exploits the sparse representation algorithm for the classification of thermal probe images. According to the experimental results, our proposed algorithm leads significant performance improvements in the area of thermal to visible face recognition and achieves the average Rank-1 accuracy of 89.33 percent.

[1]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Lior Wolf,et al.  Using Biologically Inspired Features for Face Processing , 2007, International Journal of Computer Vision.

[3]  Fei Chen,et al.  A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference , 2010, IEEE Transactions on Multimedia.

[4]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Rama Chellappa,et al.  Coupled dictionaries for thermal to visible face recognition , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[6]  Chao Zhang,et al.  Hallucinating faces from thermal infrared images , 2008, 2008 15th IEEE International Conference on Image Processing.

[7]  M. Saquib Sarfraz,et al.  Deep Perceptual Mapping for Thermal to Visible Face Recogntion , 2015, BMVC.

[8]  Seong G. Kong,et al.  Recent advances in visual and infrared face recognition - a review , 2005, Comput. Vis. Image Underst..

[9]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[10]  Larry S. Davis,et al.  Thermal to visible face recognition , 2012, Defense + Commercial Sensing.

[11]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[12]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[13]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Anil K. Jain,et al.  Heterogeneous Face Recognition Using Kernel Prototype Similarities , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.