Composite sketch recognition using saliency and attribute feedback

Propose composite sketch to photo matching algorithm using visual saliency and combination of texture features.Attributes such as gender and ethnicity information is used to improve recognition performance.Multiple experts such as sketches from different artists are combined for further increasing accuracy. Recent interest and requirement of law enforcement agencies in matching composite sketches with digital images has instigated research in this important face recognition problem. In this paper, we propose feature extraction and matching algorithm using visual saliency and combination of texture features for matching composite sketches with digital photos. The attributes such as gender, ethnicity, and skin color are utilized for re-ordering the ranked list. Further, information from multiple experts such as multiple composite sketch generation tools or artists is combined for improving the matching performance. The results obtained on the extended PRIP database show that the proposed algorithm improves the state-of-art in matching composite sketch and digital face images and yields the rank 50 identification accuracy of 70.3% on a database of 1500 subjects.

[1]  Arun Ross,et al.  Handbook of Multibiometrics (International Series on Biometrics) , 2006 .

[2]  Xiaogang Wang,et al.  Face Photo-Sketch Synthesis and Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Anil K. Jain,et al.  Sketch based face recognition: Forensic vs. composite sketches , 2013, 2013 International Conference on Biometrics (ICB).

[4]  Xiaogang Wang,et al.  Face sketch recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Amit R.Sharma,et al.  Face Photo-Sketch Synthesis and Recognition , 2012 .

[6]  Daijin Kim,et al.  Robust Real-Time Face Detection Using Face Certainty Map , 2007, ICB.

[7]  Richa Singh,et al.  Recognizing composite sketches with digital face images via SSD dictionary , 2014, IEEE International Joint Conference on Biometrics.

[8]  P. Hancock,et al.  Whole-face procedures for recovering facial images from memory. , 2013, Science & justice : journal of the Forensic Science Society.

[9]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[11]  Anil K. Jain,et al.  Heterogeneous Face Recognition Using Kernel Prototype Similarities , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  A. Martínez,et al.  The AR face databasae , 1998 .

[13]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[15]  Richa Singh,et al.  Composite sketch recognition via deep network - a transfer learning approach , 2015, 2015 International Conference on Biometrics (ICB).

[16]  Kurt Hugenberg,et al.  The categorization-individuation model: an integrative account of the other-race recognition deficit. , 2010, Psychological review.

[17]  H. Proença,et al.  Biometric Identification from Facial Sketches of Poor Reliability: Comparison of Human and Machine Performance , 2014 .

[18]  Himanshu S. Bhatt,et al.  Matching age separated composite sketches and digital face images , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[19]  Paul Suetens,et al.  Modeling 3D Facial Shape from DNA , 2014, PLoS genetics.

[20]  Himanshu S. Bhatt,et al.  On matching sketches with digital face images , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[21]  M. Grabisch.  The application of fuzzy integrals in multicriteria decision making , 1996 .

[22]  H. Ellis,et al.  Identification of Familiar and Unfamiliar Faces from Internal and External Features: Some Implications for Theories of Face Recognition , 1979, Perception.

[23]  Xiaogang Wang,et al.  Lighting and Pose Robust Face Sketch Synthesis , 2010, ECCV.

[24]  Anil K. Jain,et al.  Face Recognition Performance: Role of Demographic Information , 2012, IEEE Transactions on Information Forensics and Security.

[25]  Yong Zhang,et al.  Hand-Drawn Face Sketch Recognition by Humans and a PCA-Based Algorithm for Forensic Applications , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[26]  Lior Wolf,et al.  Robust boosting for learning from few examples , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  Yong Zhang,et al.  Human and Computer Evaluations of Face Sketches with Implications for Forensic Investigations , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[28]  Richa Singh,et al.  Boosting local descriptors for matching composite and digital face images , 2013, 2013 IEEE International Conference on Image Processing.

[29]  Qi Zhao,et al.  Learning saliency-based visual attention: A review , 2013, Signal Process..

[30]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..

[31]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  D. Wright,et al.  An own gender bias and the importance of hair in face recognition. , 2003, Acta psychologica.

[33]  Himanshu S. Bhatt,et al.  Memetically Optimized MCWLD for Matching Sketches With Digital Face Images , 2012, IEEE Transactions on Information Forensics and Security.

[34]  Anil K. Jain,et al.  The FaceSketchID System: Matching Facial Composites to Mugshots , 2014, IEEE Transactions on Information Forensics and Security.

[35]  Sayan Mukherjee,et al.  Feature Selection for SVMs , 2000, NIPS.

[36]  Hanqing Lu,et al.  A nonlinear approach for face sketch synthesis and recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[37]  Anil K. Jain,et al.  Matching Composite Sketches to Face Photos: A Component-Based Approach , 2013, IEEE Transactions on Information Forensics and Security.