Soft Biometrics and Their Application in Person Recognition at a Distance

Soft biometric information extracted from a human body (e.g., height, gender, skin color, hair color, and so on) is ancillary information easily distinguished at a distance but it is not fully distinctive by itself in recognition tasks. However, this soft information can be explicitly fused with biometric recognition systems to improve the overall recognition when confronting high variability conditions. One significant example is visual surveillance, where face images are usually captured in poor quality conditions with high variability and automatic face recognition systems do not work properly. In this scenario, the soft biometric information can provide very valuable information for person recognition. This paper presents an experimental study of the benefits of soft biometric labels as ancillary information based on the description of human physical features to improve challenging person recognition scenarios at a distance. In addition, we analyze the available soft biometric information in scenarios of varying distance between camera and subject. Experimental results based on the Southampton multibiometric tunnel database show that the use of soft biometric traits is able to improve the performance of face recognition based on sparse representation on real and ideal scenarios by adaptive fusion rules.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  A.K. Jain,et al.  Scars, marks and tattoos (SMT): Soft biometric for suspect and victim identification , 2008, 2008 Biometrics Symposium.

[3]  A. Dantcheva,et al.  Bag of Soft Biometrics for Person Identification New trends and challenges , 2011 .

[4]  D. Heckathorn,et al.  A Methodology for Reducing Respondent Duplication and Impersonation in Samples of Hidden Populations , 2001 .

[5]  Anil K. Jain,et al.  Face Matching and Retrieval Using Soft Biometrics , 2010, IEEE Transactions on Information Forensics and Security.

[6]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[7]  Johannes Hewig,et al.  Gender Differences for Specific Body Regions When Looking at Men and Women , 2008 .

[8]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  M. Lee,et al.  The University of Southampton Multi-Biometric Tunnel and introducing a novel 3D gait dataset , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[10]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[11]  M.S. Nixon,et al.  The Use of Semantic Human Description as a Soft Biometric , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[12]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  Anil K. Jain,et al.  Soft Biometric Traits for Personal Recognition Systems , 2004, ICBA.

[14]  Anil K. Jain,et al.  Integrating Faces, Fingerprints, and Soft Biometric Traits for User Recognition , 2004, ECCV Workshop BioAW.

[15]  Julian Fiérrez,et al.  Rapid and brief communication: Discriminative multimodal biometric authentication based on quality measures , 2005 .

[16]  Julian Fiérrez,et al.  Scenario-based score fusion for face recognition at a distance , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[17]  Anil K. Jain,et al.  Facial marks: Soft biometric for face recognition , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[18]  Massimo Tistarelli,et al.  Handbook of Remote Biometrics: for Surveillance and Security , 2009 .

[19]  Massimo Tistarelli,et al.  Biometrics at a Distance: Issues, Challenges, and Prospects , 2009, Handbook of Remote Biometrics.

[20]  Ke Huang,et al.  Sparse Representation for Signal Classification , 2006, NIPS.

[21]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[22]  Thomas S. Huang,et al.  Soft biometrics for video surveillance , 2009 .

[23]  Jean-Luc Dugelay,et al.  Bag of soft biometrics for person identification , 2010, Multimedia Tools and Applications.

[24]  Arun Ross,et al.  Predictability and correlation in human metrology , 2010, 2010 IEEE International Workshop on Information Forensics and Security.

[25]  Mark S. Nixon,et al.  Human identification using facial comparative descriptions , 2013, 2013 International Conference on Biometrics (ICB).

[26]  Sridha Sridharan,et al.  Soft-Biometrics: Unconstrained Authentication in a Surveillance Environment , 2009, 2009 Digital Image Computing: Techniques and Applications.

[27]  C. Macrae,et al.  Social cognition: thinking categorically about others. , 2000, Annual review of psychology.

[28]  Larry S. Davis,et al.  Beyond Nouns: Exploiting Prepositions and Comparative Adjectives for Learning Visual Classifiers , 2008, ECCV.

[29]  J. Shepherd,et al.  Adult Eyewitness Testimony: Whole body information: Its relevance to eyewitnesses , 1994 .

[30]  Rogério Schmidt Feris,et al.  Attribute-based people search in surveillance environments , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[31]  R. D. Seely,et al.  On a three-dimensional gait recognition system , 2010 .