Subsurface scattering deconvolution for improved NIR-visible facial image correlation

Significant improvements in face-recognition performance have recently been achieved by obtaining near infrared (NIR) probe images. We demonstrate that by taking into account the differential effects of sub-surface scattering, correlation between facial images in the visible (VIS) and NIR wavelengths can be significantly improved. Hence, by using Fourier analysis and Gaussian deconvolution with variable thresholds for the scattering deconvolution radius and frequency, sub-surface scattering effects are largely eliminated from perpendicular isomap transformations of the facial images. (Isomap images are obtained via scanning reconstruction, as in our case, or else, more generically, via model fitting). Thus, small-scale features visible in both the VIS and NIR, such as skin-pores and certain classes of skin-mottling, can be equally weighted within the correlation analysis. The method can consequently serves as the basis for more detailed forms of facial comparison.

[1]  Wen-Hung Liao,et al.  Homomorphic processing techniques for near-infrared images , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[2]  A. Welch,et al.  A review of the optical properties of biological tissues , 1990 .

[3]  Josef Kittler,et al.  Ambient Illumination Variation Removal by Active Near-IR Imaging , 2006, ICB.

[4]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[5]  Tena Rodriguez,et al.  3D face modelling for 2D+3D face recognition , 2007 .

[6]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Dong Yi,et al.  Face Matching Between Near Infrared and Visible Light Images , 2007, ICB.

[8]  Josef Kittler,et al.  Quality Controlled Multimodal Fusion of Biometric Experts , 2007, CIARP.

[9]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[10]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Qu Hai-bin,et al.  Background correction in near-infrared spectra of plant extracts by orthogonal signal correction , 2008, Journal of Zhejiang University Science B.

[12]  Hai-bin Qu,et al.  Background correction in near-infrared spectra of plant extracts by orthogonal signal correction. , 2005, Journal of Zhejiang University. Science. B.

[13]  Henrik Wann Jensen,et al.  A rapid hierarchical rendering technique for translucent materials , 2005, ACM Trans. Graph..

[14]  F. E. Nicodemus,et al.  Geometrical considerations and nomenclature for reflectance , 1977 .

[15]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Dong Liu,et al.  Outdoor Face Recognition Using Enhanced Near Infrared Imaging , 2007, ICB.

[17]  K. Unsworth,et al.  A model for measurement of noise in CCD digital-video cameras , 2008 .

[18]  Horst Bischof,et al.  3D and Infrared Face Reconstruction from RGB data using Canonical Correlation Analysis , 2006, 18th International Conference on Pattern Recognition (ICPR'06).