Frontal-to-side face re-identification based on hair, skin and clothes patches

Despite recent advances, face-recognition algorithms are still challenged when applied in the setting of video surveillance systems which inherently introduce variations in the pose of subjects. The present work addresses this problem, and seeks to provide a recognition algorithm that is specifically suited for a frontal-to-side re-identification setting. Deviating from classical biometric approaches, the proposed method considers color- and texture- based soft biometric traits, specifically those taken from patches of hair, skin and clothes. The proposed method and the suitability of these patch-based traits are then validated both analytically and empirically.

[1]  Jonathan Warrell,et al.  Tied Factor Analysis for Face Recognition across Large Pose Differences , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Shizuo Sakamoto,et al.  An appearance model constructed on 3-D surface for robust face recognition against pose and illumination variations , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Anil K. Jain,et al.  Soft Biometric Traits for Personal Recognition Systems , 2004, ICBA.

[4]  Antitza Dantcheva.  Search pruning with soft biometric systems : efficiency-reliability tradeoff , 2011 .

[5]  Jean-Luc Dugelay,et al.  Person recognition using a bag of facial soft biometrics (BoFSB) , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[6]  Yongsheng Gao,et al.  Face recognition across pose: A review , 2009, Pattern Recognit..

[7]  Gerhard Rigoll,et al.  Recognition of face profiles from the mugshot database using a hybrid connectionist/HMM approach , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[8]  G. Rigoll,et al.  Hybrid Profile Recognition on the MUGSHOT Database , 2005, EUROCON 2005 - The International Conference on "Computer as a Tool".

[9]  L. Sweeney,et al.  Trail Re-Identification: Learning Who You Are From Where You Have Been , 2003 .

[10]  Jean-Luc Dugelay,et al.  Soft biometrics systems: Reliability and asymptotic bounds , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[11]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[13]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[14]  Anil K. Jain,et al.  Facial marks: Soft biometric for face recognition , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[15]  Anil K. Jain,et al.  Soft Biometric Traits for Continuous User Authentication , 2010, IEEE Transactions on Information Forensics and Security.

[16]  Arun Ross,et al.  A Mosaicing Scheme for Pose-Invariant Face Recognition , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  M.S. Nixon,et al.  The Use of Semantic Human Description as a Soft Biometric , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.