FACE RECOGNITION UNDER POSE AND EXPRESIVITY VARIATION USING THERMAL AND VISIBLE IMAGES

Many existing works in face recognition are based solely on visible images. The use of bimodal systems based on visible and thermal images is seldom reported in face recognition, despite its advantage of combining the discriminative power of both modalities, under expressions or pose variations. In this paper, we investigate the combined advantages of thermal and visible face recognition on a Principal Component Analysis (PCA) induced feature space, with PCA applied on each spectrum, on a relatively new thermal/visible face database – OTCBVS, for large pose and expression variations. The recognition is done through two fusion schemes based on k-Nearest Neighbors classification and on Support Vector Machines. Our findings confirm that the recognition results are improved by the aid of thermal images over the classical approaches on visible images alone, when a suitably chosen classifier fusion is employed.

[1]  Robert Sabourin,et al.  “One Against One” or “One Against All”: Which One is Better for Handwriting Recognition with SVMs? , 2006 .

[2]  Xiao-Yuan Jing,et al.  Face and palmprint feature level fusion for single sample biometrics recognition , 2007, Neurocomputing.

[3]  Ioannis Pavlidis,et al.  Infrared and visible image fusion for face recognition , 2004, SPIE Defense + Commercial Sensing.

[4]  Miao Qi,et al.  Multimodal Biometric Identification Approach Based on Face and Palmprint , 2009, 2009 Second International Symposium on Electronic Commerce and Security.

[5]  Xin Chen,et al.  Multi-biometrics using facial appearance, shape and temperature , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[6]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[7]  Dongjian He,et al.  Face Recognition Using (2D)^2PCA and Wavelet Packet Decomposition , 2008, 2008 Congress on Image and Signal Processing.

[8]  Jean Dezert,et al.  Applications and Advances of DSmT for Information Fusion , 2004 .

[9]  Kar-Ann Toh,et al.  Robust Identity Verification Based on Infrared Face Images , 2007, 2007 International Conference on Convergence Information Technology (ICCIT 2007).

[10]  Wen Hu,et al.  Wavelet Based Sub-space Features for Face Recognition , 2008, 2008 Congress on Image and Signal Processing.

[11]  Slobodan Ribaric,et al.  A biometric identification system based on eigenpalm and eigenfinger features , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Diego A. Socolinsky,et al.  Appearance-Based Facial Recognition Using Visible and Thermal Imagery: A Comparative Study , 2006 .

[13]  Bhavani M. Thuraisingham,et al.  Face Recognition Using Multiple Classifiers , 2006, 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'06).

[14]  A. Salgian,et al.  Thermal face recognition in an operational scenario , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  H. Wang,et al.  An Improved PCA Face Recognition Algorithm Based on the Discrete Wavelet Transform and the Support Vector Machines , 2007, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007).

[16]  Richa Singh,et al.  Integrated multilevel image fusion and match score fusion of visible and infrared face images for robust face recognition , 2008, Pattern Recognit..

[17]  Francine J. Prokoski,et al.  Identification of individuals by means of facial thermography , 1992, Proceedings 1992 International Carnahan Conference on Security Technology: Crime Countermeasures.

[18]  Xin Chen,et al.  PCA-Based Face Recognition in Infrared Imagery: Baseline and Comparative Studies , 2003, AMFG.

[19]  Shigeyuki Tomita,et al.  Face identification using thermal image processing , 1997, Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI.

[20]  L. Miclea,et al.  Computational Complexity Reduction of the Support Vector Machine Classifiers for Image Analysis Tasks Through the Use of the Discrete Cosine Transform , 2006, 2006 IEEE International Conference on Automation, Quality and Testing, Robotics.

[21]  Masoud Mazloom,et al.  Combinational Method for Face Recognition: Wavelet, PCA and ANN , 2008, 2008 Digital Image Computing: Techniques and Applications.

[23]  Subhas Hati,et al.  Decision Fusion Based on Voting Scheme for IR and Visible Face Recognition , 2007, Computer Graphics, Imaging and Visualisation (CGIV 2007).

[24]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Seong G. Kong,et al.  Recent advances in visual and infrared face recognition - a review , 2005, Comput. Vis. Image Underst..

[26]  Andrea Salgian,et al.  Face recognition with visible and thermal infrared imagery , 2003, Comput. Vis. Image Underst..

[27]  Maya R. Gupta,et al.  Wavelet Principal Component Analysis and its Application to Hyperspectral Images , 2006, 2006 International Conference on Image Processing.

[28]  Alex Pentland,et al.  Eigenfaces for Face Recognition , 1991 .

[29]  Holger Schwenk,et al.  The Diabolo Classifier , 1998, Neural Computation.

[30]  Marinette Revenu,et al.  Fusion of IR and visible light modalities for face recognition , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[31]  Anil K. Jain,et al.  Integrating Faces and Fingerprints for Personal Identification , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Florentin Smarandache,et al.  Advances and Applications of DSmT for Information Fusion , 2004 .

[33]  Yun Zhang,et al.  Face recognition based on wavelet transform and SVM , 2005, 2005 IEEE International Conference on Information Acquisition.

[34]  Ioannis Pitas,et al.  A Support Vector Machine-Based Dynamic Network for Visual Speech Recognition Applications , 2002, EURASIP J. Adv. Signal Process..

[35]  David Zhang,et al.  Face and palmprint pixel level fusion and Kernel DCV-RBF classifier for small sample biometric recognition , 2007, Pattern Recognit..