Adaptive polar transform and fusion for human face image processing and evaluation

Human face processing and evaluation is a problem due to variations in orientation, size, illumination, expression, and disguise. The goal of this work is threefold. First, we aim to show that the variant of polar transformation can be used to register face images against changes in pose and size. Second, implementation of fusion of thermal and visual face images in the wavelet domain to handle illumination and disguise and third, principal component analysis is applied in order to tackle changes due to expressions up to a particular extent of degrees. Finally, a multilayer perceptron has been used to classify the face image. Several techniques have been implemented here to depict an idea about improvement of results. Methods started from the simplest design, without registration; only combination of PCA and MLP as a method for dimensionality reduction and classification respectively to the range of adaptive polar registration, fusion in wavelet transform domain and final classification using MLP. A consistent increase in recognition performance has been observed. Experiments were conducted on two separate databases and results yielded are very much satisfactory for adaptive polar registration along with fusion of thermal and visual images in the wavelet domain.

[1]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[2]  Veikko Surakka,et al.  Feature-based detection of facial landmarks from neutral and expressive facial images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Shinjiro Kawato,et al.  Two-step approach for real-time eye tracking with a new filtering technique , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[4]  Seong G. Kong,et al.  Fusion of Visual and Thermal Signatures with Eyeglass Removal for Robust Face Recognition , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[5]  Mahantapas Kundu,et al.  Classification of Log-Polar-Visual Eigenfaces using Multilayer Perceptron , 2010, ArXiv.

[6]  Mukesh A. Zaveri,et al.  A Novel Region Based Multimodality Image Fusion Method , 2011 .

[7]  Pradeep Buddharaju,et al.  Biometrics: Face Recognition in Thermal Infrared , 2005 .

[8]  Richa Singh,et al.  Integrated multilevel image fusion and match score fusion of visible and infrared face images for robust face recognition , 2008, Pattern Recognit..

[9]  Mita Nasipuri,et al.  Polar fusion technique analysis for evaluating the performances of image fusion of thermal and visual images for human face recognition , 2011, 2011 IEEE Workshop on Computational Intelligence in Biometrics and Identity Management (CIBIM).

[10]  Mita Nasipuri,et al.  Human face recognition using fuzzy multilayer perceptron , 2010, Soft Comput..

[11]  Mahantapas Kundu,et al.  Classification of fused face images using multilayer perceptron neural network , 2010, ArXiv.

[12]  Chengjun Liu,et al.  A Hybrid Color and Frequency Features Method for Face Recognition , 2008, IEEE Transactions on Image Processing.

[13]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[14]  Tsuhan Chen,et al.  Learning patch correspondences for improved viewpoint invariant face recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  R. Matungka,et al.  2D invariant object recognition using Log-Polar transform , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[16]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[17]  M. Nasipuri,et al.  Multisensor fusion of visual and thermal images for human face identification using different SVM kernels , 2012, 2012 IEEE Long Island Systems, Applications and Technology Conference (LISAT).

[18]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[19]  Mita Nasipuri,et al.  UGC-JU face database and its benchmarking using linear regression classifier , 2013, Multimedia Tools and Applications.

[20]  I. Pavlidis,et al.  The imaging issue in an automatic face/disguise detection system , 2000, Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (Cat. No.PR00640).

[21]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Mita Nasipuri,et al.  Eye region-based fusion technique of thermal and dark visual images for human face recognition , 2012 .

[23]  Massimo Tistarelli,et al.  Face recognition by fusion of local and global matching scores using DS theory: An evaluation with uni-classifier and multi-classifier paradigm , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[24]  Usman Ali,et al.  Optimized Visual and Thermal Image Fusion for Efficient Face Recognition , 2006, 2006 9th International Conference on Information Fusion.

[25]  Mahantapas Kundu,et al.  Classification of fused images using radial basis function neural network for human face recognition , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[26]  Ioannis T. Pavlidis,et al.  Face Detection in the Near-IR Spectrum , 2003, Image Vis. Comput..

[27]  Mita Nasipuri,et al.  Independent component analysis (ICA) of fused wavelet coefficients of thermal and visual images for human face recognition , 2011, Defense + Commercial Sensing.

[28]  Mahantapas Kundu,et al.  Optimum fusion of visual and thermal face images for recognition , 2010, 2010 Sixth International Conference on Information Assurance and Security.

[29]  Mahantapas Kundu,et al.  Classification of Polar-Thermal Eigenfaces using Multilayer Perceptron for Human Face Recognition , 2008, 2008 IEEE Region 10 and the Third international Conference on Industrial and Information Systems.

[30]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[31]  Yung-Chang Chen,et al.  Kernel-Based Pose Invariant Face Recognition , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[32]  Saurabh Singh,et al.  Face recognition by fusing thermal infrared and visible imagery , 2006, Image Vis. Comput..

[33]  Ioannis A. Kakadiaris,et al.  Face Recognition in the Thermal Infrared Spectrum , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[34]  M. Sasikumar,et al.  Analysis of Facial Expressions from Video Images using PCA , 2008 .

[35]  Mahantapas Kundu,et al.  Image Pixel Fusion for Human Face Recognition , 2010, ArXiv.

[36]  Sang Chul Ahn,et al.  Glasses removal from facial image using recursive error compensation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[38]  Yuan F. Zheng,et al.  Image Registration Using Adaptive Polar Transform , 2009, IEEE Transactions on Image Processing.

[39]  George Wolberg,et al.  Image registration using log-polar mappings for recovery of large-scale similarity and projective transformations , 2005, IEEE Transactions on Image Processing.

[40]  Qiuqi Ruan,et al.  Two-Dimension PCA for Facial Expression Recognition , 2006, 2006 8th international Conference on Signal Processing.

[41]  Mahantapas Kundu,et al.  Human Face Recognition using Line Features , 2010, ArXiv.