Facial soft biometric features for forensic face recognition.

This paper proposes a functional feature-based approach useful for real forensic caseworks, based on the shape, orientation and size of facial traits, which can be considered as a soft biometric approach. The motivation of this work is to provide a set of facial features, which can be understood by non-experts such as judges and support the work of forensic examiners who, in practice, carry out a thorough manual comparison of face images paying special attention to the similarities and differences in shape and size of various facial traits. This new approach constitutes a tool that automatically converts a set of facial landmarks to a set of features (shape and size) corresponding to facial regions of forensic value. These features are furthermore evaluated in a population to generate statistics to support forensic examiners. The proposed features can also be used as additional information that can improve the performance of traditional face recognition systems. These features follow the forensic methodology and are obtained in a continuous and discrete manner from raw images. A statistical analysis is also carried out to study the stability, discrimination power and correlation of the proposed facial features on two realistic databases: MORPH and ATVS Forensic DB. Finally, the performance of both continuous and discrete features is analyzed using different similarity measures. Experimental results show high discrimination power and good recognition performance, especially for continuous features. A final fusion of the best systems configurations achieves rank 10 match results of 100% for ATVS database and 75% for MORPH database demonstrating the benefits of using this information in practice.

[1]  B. Heisele Face Detection , 2001 .

[2]  Bruce A. Draper,et al.  Computational Statistics and Data Analysis Introduction to Face Recognition and Evaluation of Algorithm Performance , 2022 .

[3]  Anil K. Jain,et al.  Soft Biometric Traits for Continuous User Authentication , 2010, IEEE Transactions on Information Forensics and Security.

[4]  A.K. Jain,et al.  Scars, marks and tattoos (SMT): Soft biometric for suspect and victim identification , 2008, 2008 Biometrics Symposium.

[5]  Alphonse Bertillon,et al.  Signaletic instructions including the theory and practice of anthropometrical identification , 2022 .

[6]  Anil K. Jain,et al.  Soft Biometric Traits for Personal Recognition Systems , 2004, ICBA.

[7]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[8]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Anil K. Jain,et al.  Facial marks: Soft biometric for face recognition , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[10]  C. Cacou Anthropometry of the head and face , 1995 .

[11]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[13]  Tomaso A. Poggio,et al.  Face recognition: component-based versus global approaches , 2003, Comput. Vis. Image Underst..

[14]  Anil K. Jain,et al.  Component-Based Representation in Automated Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[15]  A B WALLACE,et al.  Scars. , 2019, Nursing times.

[16]  Anil K. Jain,et al.  On a taxonomy of facial features , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[17]  Julian Fiérrez,et al.  Fusion of Facial Regions Using Color Information in a Forensic Scenario , 2013, CIARP.

[18]  M. A. Grudin,et al.  On internal representations in face recognition systems , 2000, Pattern Recognit..

[19]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[20]  Anil K. Jain,et al.  Suspect identification based on descriptive facial attributes , 2014, IEEE International Joint Conference on Biometrics.

[21]  Julian Fiérrez,et al.  Analysis of the variability of facial landmarks in a forensic scenario , 2013, 2013 International Workshop on Biometrics and Forensics (IWBF).

[22]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[23]  D. Heckathorn,et al.  A Methodology for Reducing Respondent Duplication and Impersonation in Samples of Hidden Populations , 2001 .

[24]  Mark S. Nixon,et al.  Human identification using facial comparative descriptions , 2013, 2013 International Conference on Biometrics (ICB).

[25]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Glenn Porter,et al.  Law's Looking Glass: Expert Identification Evidence Derived from Photographic and Video Images , 2009 .

[27]  Henry T. F. b. Rhodes,et al.  Alphonse Bertillon, Father of Scientific Detection , 2013 .

[28]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[29]  Lluís A. Belanche Muñoz,et al.  Feature selection algorithms: a survey and experimental evaluation , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[30]  Anil K. Jain,et al.  Integrating Faces, Fingerprints, and Soft Biometric Traits for User Recognition , 2004, ECCV Workshop BioAW.

[31]  Rabia Jafri,et al.  A Survey of Face Recognition Techniques , 2009, J. Inf. Process. Syst..

[32]  Xiaoou Tang,et al.  Facial Landmark Detection by Deep Multi-task Learning , 2014, ECCV.

[33]  Anil K. Jain,et al.  Face Matching and Retrieval Using Soft Biometrics , 2010, IEEE Transactions on Information Forensics and Security.

[34]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[35]  Alvin F. Martin,et al.  The NIST speaker recognition evaluation program , 2005 .

[36]  Julian Fiérrez,et al.  Comparative Analysis of the Variability of Facial Landmarks for Forensics Using CCTV Images , 2013, PSIVT.

[37]  Douglas A. Reynolds,et al.  The NIST speaker recognition evaluation - Overview, methodology, systems, results, perspective , 2000, Speech Commun..

[38]  Richard Guest,et al.  Information technology -- 29107-7 Conformance testing methodology for biometric data interchange formats defined in ISO/IEC 19794 -- Part 7: Signature/sign time series data , 2011 .

[39]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[40]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[41]  Julian Fiérrez,et al.  Soft Biometrics and Their Application in Person Recognition at a Distance , 2014, IEEE Transactions on Information Forensics and Security.

[42]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[43]  Julian Fierrez,et al.  Identification using face regions: application and assessment in forensic scenarios. , 2013, Forensic science international.