Face recognition in low resolution thermal images

This paper proposes an accurate, rotation invariant, and fast approach for detection of facial features from thermal images. The proposed approach combines both appearance and geometric information to detect the facial features. A texture based detector is performed using Haar features and AdaBoost algorithm. Then the relation between these facial features is modeled using a complex Gaussian distribution, which is invariant to rotation. Experiments show that our proposed approach outperforms existing algorithms for facial features detection in thermal images. The proposed approach's performance is illustrated in a face recognition framework, which is based on extracting a local signature around facial features. Also, the paper presents a comparative study for different signature techniques with different facial image resolutions. The results of this comparative study suggest the minimum facial image resolution in thermal images, which can be used in face recognition. The study also gives a guideline for choosing a good signature, which leads to the best recognition rate.

[1]  Cordelia Schmid,et al.  Is that you? Metric learning approaches for face identification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Diego A. Socolinsky,et al.  Appearance-Based Facial Recognition Using Visible and Thermal Imagery: A Comparative Study , 2006 .

[3]  Pradeep Buddharaju,et al.  Physiology-Based Face Recognition in the Thermal Infrared Spectrum , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Javier Ruiz-del-Solar,et al.  Face recognition using thermal infrared images for Human-Robot Interaction applications: A comparative study , 2009, 2009 6th Latin American Robotics Symposium (LARS 2009).

[5]  Zhi-Hua Zhou,et al.  Face recognition from a single image per person: A survey , 2006, Pattern Recognit..

[6]  Maja Pantic,et al.  Facial component detection in thermal imagery , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[7]  Andrea Salgian,et al.  A comparative analysis of face recognition performance with visible and thermal infrared imagery , 2002, Object recognition supported by user interaction for service robots.

[8]  Leonardo Trujillo,et al.  Automatic Feature Localization in Thermal Images for Facial Expression Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[9]  Subhas Hati,et al.  IR and visible face recognition using fusion of kernel based features , 2008, 2008 19th International Conference on Pattern Recognition.

[10]  B. Abidi,et al.  Fusion of visual, thermal, and range as a solution to illumination and pose restrictions in face recognition , 2004, 38th Annual 2004 International Carnahan Conference on Security Technology, 2004..

[11]  Seong G. Kong,et al.  Recent advances in visual and infrared face recognition - a review , 2005, Comput. Vis. Image Underst..

[12]  Andrea Salgian,et al.  Appearance-based object recognition using multiple views , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Javier Ruiz-del-Solar,et al.  A comparative study of thermal face recognition methods in unconstrained environments , 2012, Pattern Recognit..

[14]  Xin Chen,et al.  IR and visible light face recognition , 2005, Comput. Vis. Image Underst..

[15]  Josef Kittler,et al.  Face Recognition with LWIR Imagery Using Local Binary Patterns , 2009, ICB.

[16]  Aurel Vlaicu,et al.  Fusion based approach for thermal and visible face recognition under pose and expresivity variation , 2010, 9th RoEduNet IEEE International Conference.

[17]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[18]  Bruce A. Draper,et al.  A meta-analysis of face recognition covariates , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[19]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[20]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Kanti V. Mardia,et al.  The Statistical Analysis of Shape , 1998 .

[22]  Binoy Pinto,et al.  Speeded Up Robust Features , 2011 .

[23]  Javier Ruiz-del-Solar,et al.  Thermal Face Recognition Using Local Interest Points and Descriptors for HRI Applications , 2010, RoboCup.

[24]  Saurabh Singh,et al.  Face recognition by fusing thermal infrared and visible imagery , 2006, Image Vis. Comput..