On matching digital face images against scanned passport photos

In this paper the problem of matching high-resolution digital face images against low-resolution passport photos scanned from the original document is studied. The challenges involved in such a problem are quite different from those encountered by classical facial matching systems described in the literature. These challenges can be person-related, document-related or scanning device-related. Thus, the matching performance of face recognition algorithms can be significantly impacted when tested on passport photos scanned by an external device. The purpose of this paper is to illustrate the complexity of the passport facial matching problem and to provide a preliminary solution to it. The contributions of this work are two-fold. Firstly, a database of 25 subjects is assembled and used to illustrate the challenges associated with passport facial matching. Secondly, a pre-processing scheme is proposed in order to denoise and eliminate watermark traces that may be present in scanned passport photos. The application of such a pre-processing scheme is observed to improve the performance of classical face matching systems. To the best of our knowledge, this is the first time that this problem is being investigated in the open literature in the context of international passports exhibiting a variety of facial image qualities and security marks.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .

[3]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[4]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[5]  Shaohua Zhou,et al.  Unconstrained Face Recognition , 2005 .

[6]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jiri Matas,et al.  Analysis of LDA-based matching schemes for Face Verification , 2007 .

[8]  D. Donoho,et al.  Translation-Invariant De-Noising , 1995 .

[9]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Yajie Tian,et al.  Handbook of face recognition , 2003 .

[11]  Rapport DU Capscaafrica,et al.  INTERNATIONAL CIVIL AVIATION ORGANIZATION , 1947, International Organization.

[12]  Andrew F. Rolle,et al.  Encyclopedia of Frontier Biography , 1995 .

[13]  Bülent Sankur,et al.  Matching of faces in camera images and document photographs , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[14]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[15]  S. Arumuga Perumal,et al.  Image De-noising using Discrete Wavelet transform , 2008 .

[16]  Richa Singh,et al.  Age Transformation for Improving Face Recognition Performance , 2007, PReMI.

[17]  Helmut Volger.  ICAO – International Civil Aviation Organization , 2010 .

[18]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[19]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[20]  Jiri Matas,et al.  On Matching Scores for LDA-based Face Verification , 2000, BMVC.

[21]  Dmitry Samal,et al.  THREE APPROACHES FOR FACE RECOGNITION , 2002 .

[22]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[23]  J. L. Hodges,et al.  Discriminatory Analysis - Nonparametric Discrimination: Consistency Properties , 1989 .

[24]  Elliott West,et al.  Encyclopedia of Frontier Biography , 1988 .