Classification of fused face images using multilayer perceptron neural network

This paper presents a concept of image pixel fusion of visual and thermal faces, which can significantly improve the overall performance of a face recognition system. Several factors affect face recognition performance including pose variations, facial expression changes, occlusions, and most importantly illumination changes. So, image pixel fusion of thermal and visual images is a solution to overcome the drawbacks present in the individual thermal and visual face images. Fused images are projected into eigenspace and finally classified using a multi-layer perceptron. In the experiments we have used Object Tracking and Classification Beyond Visible Spectrum (OTCBVS) database benchmark thermal and visual face images. Experimental results show that the proposed approach significantly improves the verification and identification performance and the success rate is 95.07%. The main objective of employing fusion is to produce a fused image that provides the most detailed and reliable information. Fusion of multiple images together produces a more efficient representation of the image.

[1]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[2]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[3]  Ioannis Pavlidis,et al.  Infrared and visible image fusion for face recognition , 2004, SPIE Defense + Commercial Sensing.

[4]  Alexander Toet,et al.  A morphological pyramidal image decomposition , 1989, Pattern Recognit. Lett..

[5]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[6]  K AsariVijayan,et al.  An improved face recognition technique based on modular PCA approach , 2004 .

[7]  P. Jonathon Phillips,et al.  An Introduction to Evaluating Biometric Systems , 2000, Computer.

[8]  Usman Ali,et al.  Gabor Filter Based Efficient Thermal and Visual Face Recognition Using Fusion Architectures , 2006, AMT.

[9]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[10]  Terrance L. Huntsberger,et al.  Wavelet-based sensor fusion , 1993, Other Conferences.

[11]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[12]  Vijayan K. Asari,et al.  An improved face recognition technique based on modular PCA approach , 2004, Pattern Recognit. Lett..

[13]  David Hughes Sinking in a Sea of Pixels — The Case for Pixel Fusion , 2005 .

[14]  Jingu Heo,et al.  Fusion of Visual and Thermal Face Recognition Techniques : A Comparative Study , 2003 .

[15]  R.S. Blum,et al.  Experimental tests of image fusion for night vision , 2005, 2005 7th International Conference on Information Fusion.

[16]  Colin E. Reese,et al.  Comparison of additive image fusion vs. feature-level image fusion techniques for enhanced night driving , 2003, SPIE Optics + Photonics.

[17]  Ashok Samal,et al.  Automatic recognition and analysis of human faces and facial expressions: a survey , 1992, Pattern Recognit..

[18]  Usman Ali,et al.  Fusion of Thermal and Visual Images for efficient Face Recognition using Gabor Filter , 2006, IEEE International Conference on Computer Systems and Applications, 2006..

[19]  Usman Ali,et al.  Optimized Visual and Thermal Image Fusion for Efficient Face Recognition , 2006, 2006 9th International Conference on Information Fusion.

[20]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.