Evaluation of face recognition system in heterogeneous environments (visible vs NIR)

Performing facial recognition between Near Infrared (NIR) and visible-light (VIS) images has been established as a common method of countering illumination variation problems in face recognition. In this paper we present a new database to enable the evaluation of cross-spectral face recognition. A series of preprocessing algorithms, followed by Local Binary Pattern Histogram (LBPH) representation and combinations with Linear Discriminant Analysis (LDA) are used for recognition. These experiments are conducted on both NIR→VIS and the less common VIS→NIR protocols, with permutations of uni-modal training sets. 12 individual baseline algorithms are presented. In addition, the best performing fusion approaches involving a subset of 12 algorithms are also described.

[1]  Shengcai Liao,et al.  Illumination Invariant Face Recognition Using Near-Infrared Images , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Shengcai Liao,et al.  Heterogeneous Face Recognition from Local Structures of Normalized Appearance , 2009, ICB.

[3]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[5]  Stan Z. Li,et al.  The HFB Face Database for Heterogeneous Face Biometrics research , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Matti Pietikäinen,et al.  Learning mappings for face synthesis from near infrared to visual light images , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Shengcai Liao,et al.  Partial Face Matching between Near Infrared and Visual Images in MBGC Portal Challenge , 2009, ICB.

[8]  Shengcai Liao,et al.  Learning Multi-scale Block Local Binary Patterns for Face Recognition , 2007, ICB.

[9]  Jian-Jun Zhang,et al.  Self quotient image for face recognition , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[10]  Josef Kittler,et al.  Ambient Illumination Variation Removal by Active Near-IR Imaging , 2006, ICB.

[11]  Anil K. Jain,et al.  Heterogeneous Face Recognition: Matching NIR to Visible Light Images , 2010, 2010 20th International Conference on Pattern Recognition.

[12]  Timo Ojala,et al.  Experiments with two industrial problems using texture classification based on feature distributions , 1994, Other Conferences.

[13]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[14]  David Paul Casasent,et al.  Intelligent Robots and Computer Vision XIII: 3D Vision, Product Inspection, and Active Vision , 1994 .

[15]  I. Meglinski,et al.  Quantitative assessment of skin layers absorption and skin reflectance spectra simulation in the visible and near-infrared spectral regions. , 2002, Physiological measurement.

[16]  Stan Z. Li,et al.  An Analysis-by-Synthesis Method for Heterogeneous Face Biometrics , 2009, ICB.

[17]  V. Štruc.  INface: A Toolbox for Illumination Invariant Face Recognition , 2009 .

[18]  A. Welch,et al.  A review of the optical properties of biological tissues , 1990 .

[19]  Dahua Lin,et al.  Inter-modality Face Recognition , 2006, ECCV.

[20]  Dong Yi,et al.  Face Matching Between Near Infrared and Visible Light Images , 2007, ICB.

[21]  Natalia A. Schmid,et al.  A Method for Robust Multispectral Face Recognition , 2011, ICIAR.

[22]  Shuyan Zhao,et al.  An Automatic Face Recognition System in the Near Infrared Spectrum , 2005, MLDM.