Computer Vision – ECCV 2016 Workshops

Matching a face sketch against mug shots, which plays an important role in law enforcement and security, is an interesting and challenging topic in face recognition community. Although great progress has been made in recent years, main focus is the face recognition based on SINGLE sketch in existing studies. In this paper, we present a fundamental study of face recognition from multiple stylistic sketches. Three specific scenarios with corresponding datasets are carefully introduced to mimic real-world situations: (1) recognition from multiple handdrawn sketches; (2) recognition from hand-drawn sketch and composite sketches; (3) recognition from multiple composite sketches. We further provide the evaluation protocols and several benchmarks on these proposed scenarios. Finally, we discuss the plenty of challenges and possible future directions that worth to be further investigated. All the materials will be publicly available online (Available at http://chunleipeng.com/ FRMSketches.html.) for comparisons and further study of this problem.

[1]  Li Zhang,et al.  Eyewitness Face Sketch Recognition Based on Two-Step Bias Modeling , 2013, CAIP.

[2]  Yong Zhang,et al.  Hand-Drawn Face Sketch Recognition by Humans and a PCA-Based Algorithm for Forensic Applications , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[3]  Xuelong Li,et al.  Multiple Representations-Based Face Sketch–Photo Synthesis , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[5]  Jie Li,et al.  Superpixel-Based Face Sketch–Photo Synthesis , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Xinbo Gao,et al.  Face Sketch Synthesis via Sparse Representation-Based Greedy Search , 2015, IEEE Transactions on Image Processing.

[7]  Anil K. Jain,et al.  The FaceSketchID System: Matching Facial Composites to Mugshots , 2014, IEEE Transactions on Information Forensics and Security.

[8]  Richa Singh,et al.  Composite sketch recognition using saliency and attribute feedback , 2017, Inf. Fusion.

[9]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Yasushi Makihara,et al.  Multi-view discriminant analysis with tensor representation and its application to cross-view gait recognition , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[11]  Xinbo Gao,et al.  Graphical Representation for Heterogeneous Face Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Xueming Li,et al.  ForgetMeNot: Memory-Aware Forensic Facial Sketch Matching , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Xuelong Li,et al.  A Comprehensive Survey to Face Hallucination , 2013, International Journal of Computer Vision.

[14]  Hao Zhou,et al.  Markov Weight Fields for face sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Xuelong Li,et al.  Transductive Face Sketch-Photo Synthesis , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Xueming Li,et al.  Cross-Modal Face Matching: Beyond Viewed Sketches , 2014, ACCV.

[18]  Anil K. Jain,et al.  Heterogeneous Face Recognition Using Kernel Prototype Similarities , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Amit R.Sharma,et al.  Face Photo-Sketch Synthesis and Recognition , 2012 .